00000001:02000400:3.0F:1788586718.887099:0:3304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788586734.922175:0:3524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788586736.644217:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 575 MB/s 00000001:01000000:2.0:1788586736.898134:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 594 MB/s 00000001:01000000:1.0F:1788586737.147579:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4543 MB/s 00000020:02000000:1.0:1788586737.858234:0:3615:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g357faf0 00000400:02000000:0.0F:1788586738.660682:0:3630:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.101@tcp [8/256/0/180] 00008000:02000000:1.0:1788586742.567159:0:3780:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788586793.970714:0:5748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788586807.588257:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788586807.588266:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788586807.588267:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788586807.588630:0:6498:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e019e9f8 00000080:02000400:1.0:1788586807.588645:0:6498:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788586807.604317:0:6498:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788586807.604329:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788586807.604377:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ee425033) 00000020:00000080:1.0:1788586807.604397:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788586807.684287:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788586807.685051:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788586807.720492:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788586807.720785:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788586807.720793:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788586807.720807:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd935b 00000020:01000004:0.0:1788586807.720813:0:6498:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788586807.720826:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788586807.720832:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e019e9f8 from MGS 00000020:01000004:0.0:1788586807.720836:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788586807.720857:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e32b4852) 00000020:00000080:0.0:1788586807.720870:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788586807.720944:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e019e9f8 from MGS, refs=2 00080000:01000000:0.0:1788586807.720950:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788586807.720955:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd9369 00000100:00100000:0.0:1788586807.721052:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788586807.721198:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788586807.721206:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788586807.726769:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788586807.726789:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788586807.732957:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586807.733152:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788586807.733159:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788586807.737640:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788586807.737655:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788586807.738118:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788586807.738126:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788586807.738771:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586807.738774:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586807.738776:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586807.739196:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586807.739199:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586807.739201:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586807.739890:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788586807.746597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788586807.989559:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2899 MB/s 00000001:01000000:1.0:1788586808.239478:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3523 MB/s 00000001:01000000:3.0:1788586808.490819:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 486 MB/s 00000001:01000000:2.0:1788586808.742297:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 673 MB/s 00080000:10000000:3.0:1788586808.751694:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788586808.766203:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788586808.774329:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788586808.775139:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788586808.775201:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788586808.775484:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788586808.775512:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788586808.775933:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586808.778212:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788586808.778222:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788586808.782744:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788586808.782758:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788586808.784711:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788586808.784724:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788586808.787732:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788586808.787757:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.101@tcp' 00000020:01000004:0.0:1788586808.787759:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788586808.787873:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.101@tcp (typ=mgc) 00000020:00000080:0.0:1788586808.787887:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.101@tcp (000000005c168764) 00000020:00000080:0.0:1788586808.787906:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788586808.788208:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000582057d7@MGC192.168.203.101@tcp: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788586808.788389:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.101@tcp-0 is initialized 00000040:01000000:0.0:1788586808.788396:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788586808.788957:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788586808.788993:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.101@tcp (uuid 47977fce-e1b1-4b0c-879f-0e023b1316c2) 00000020:00000080:1.0:1788586808.789011:0:6498:0:(genops.c:1385:class_connect()) connect: client 47977fce-e1b1-4b0c-879f-0e023b1316c2, cookie 0xfbc93bbea5fd9377 00000100:00080000:1.0:1788586808.789022:0:6498:0:(import.c:545:import_select_connection()) MGC192.168.203.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586808.789027:0:6498:0:(import.c:665:import_select_connection()) MGC192.168.203.101@tcp: import 00000000582057d7 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586808.789069:0:6498:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000097203139 x1875469127385216/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586808.789097:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS 00000020:01000004:1.0:1788586808.789114:0:6498:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788586808.789119:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788586808.789130:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fc4fdd02) 00000020:00000080:1.0:1788586808.789140:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788586808.793586:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097203139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127385216:0@lo:250: 00000100:00100000:3.0:1788586808.793712:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788586808.793910:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788586808.793976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385216 00000100:00100000:3.0:1788586808.793984:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385216 00000100:00100000:3.0:1788586808.794030:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586808.794036:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047883d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3645:x1875469127385216:12345-0@lo:250: 00010000:00080000:3.0:1788586808.794063:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 47977fce-e1b1-4b0c-879f-0e023b1316c2@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1788586808.794094:0:6515:0:(genops.c:1385:class_connect()) connect: client 47977fce-e1b1-4b0c-879f-0e023b1316c2, cookie 0xfbc93bbea5fd9385 00000100:00080000:3.0:1788586808.794233:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000075b8be19 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586808.794281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047883d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:3645:x1875469127385216:12345-0@lo:250: Request processed in 243us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586808.794288:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586808.794484:0:3645:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788586808.794493:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.101@tcp: connect to target with instance 0 00000100:00080000:3.0:1788586808.794501:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788586808.794512:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788586808.794515:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000582057d7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788586808.794518:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788586808.794521:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788586808.794525:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097203139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127385216:0@lo:250: 00010000:00010000:2.0:1788586808.796260:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586808.811117:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586808.811459:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788586808.811466:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788586808.812392:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788586808.812402:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788586808.812998:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788586808.813006:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788586808.813909:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586808.815786:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788586808.815795:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788586808.816759:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788586808.816768:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788586808.879600:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586808.880729:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788586808.880738:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788586808.882998:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788586808.883013:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788586808.884773:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586808.885065:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788586808.885072:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788586808.885604:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788586808.885614:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788586808.886272:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586808.886488:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788586808.886494:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788586808.887097:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788586808.887105:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788586808.888639:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586808.888860:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788586808.888867:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788586808.891409:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788586808.891928:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788586808.913975:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586808.914208:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788586808.914215:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788586808.921647:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788586808.921669:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788586808.924930:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788586808.928030:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788586808.929189:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788586808.929219:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788586808.929225:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788586808.929334:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788586808.929373:0:6498:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.101@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788586808.929377:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788586808.929379:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586808.929380:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586808.929381:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586808.929382:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586808.929384:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586808.929385:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586808.929386:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586808.929387:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586808.929388:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586808.929390:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586808.929391:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788586808.929393:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788586808.929395:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788586808.929397:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586808.929398:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586808.929399:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586808.929400:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586808.929401:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586808.929402:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586808.929403:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586808.929404:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586808.929405:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586808.929411:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586808.929411:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788586808.929491:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788586808.929508:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd0e305d pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385344:0@lo:253: 00000100:00100000:1.0:1788586808.929769:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586808.930068:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:2.0:1788586808.930139:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385344 00000100:00100000:2.0:1788586808.930148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385344 00000100:00100000:2.0:1788586808.930210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586808.930220:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd4456b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6498:x1875469127385344:12345-0@lo:253: 20000000:01000000:2.0:1788586808.930268:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788586808.930271:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788586808.930606:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788586808.930669:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788586808.930978:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586808.932028:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788586808.932247:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788586808.932252:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788586808.932258:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788586808.932261:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788586808.932272:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788586808.932454:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788586808.932635:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788586808.932649:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788586808.932667:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788586808.932685:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788586808.932713:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788586808.932766:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788586808.932775:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788586808.932788:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788586808.932793:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788586808.932815:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788586808.932821:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788586808.932833:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788586808.932847:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788586808.932874:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788586808.932879:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788586808.932886:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788586808.932977:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788586808.932987:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788586808.933002:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788586808.933017:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788586808.933032:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788586808.933040:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788586808.933065:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788586808.933072:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788586808.933085:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788586808.933100:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788586808.933132:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788586808.933142:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788586808.933167:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788586808.933175:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788586808.933188:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788586808.933204:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788586808.933262:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788586808.933284:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788586808.933290:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788586808.934469:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788586808.934689:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788586808.934729:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.101@tcp for mdt 20000000:01000000:2.0:1788586808.934731:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:2.0:1788586808.934748:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788586808.934754:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788586808.934767:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788586808.934773:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:2.0:1788586808.934800:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788586808.934808:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788586808.934821:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788586808.934836:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788586808.934863:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788586808.934867:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788586808.934871:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788586808.934935:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788586808.934938:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788586808.936638:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788586808.936796:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788586808.936823:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788586808.936834:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788586808.936843:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788586808.936845:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788586808.937195:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788586808.937318:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788586808.937337:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788586808.937352:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788586808.937364:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788586808.937367:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788586808.937372:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788586808.937374:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788586808.937379:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788586808.937385:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788586808.937721:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788586808.937860:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788586808.952161:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788586808.952208:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788586808.952225:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788586808.952246:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788586808.952271:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952291:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952301:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952309:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952315:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952322:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952329:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009efe3bd8 already unused, calling callback (0000000085c85942) 00010000:00010000:3.0:1788586808.952333:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952341:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952356:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952385:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.952391:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd938c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788586808.953048:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788586808.991940:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd4456b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6498:x1875469127385344:12345-0@lo:253: Request processed in 61713us (62163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586808.991972:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586808.992653:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd0e305d pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385344:0@lo:253: 10000000:01000000:1.0:1788586808.992671:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788586808.992674:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788586808.992676:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788586808.992677:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586808.992678:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788586808.992680:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586808.992681:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586808.992682:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788586808.992683:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788586808.992684:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788586808.992685:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586808.992686:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788586808.992715:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e019e9f8 from lustre-MDT0000 10000000:01000000:1.0:1788586808.992776:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788586808.992780:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788586808.992784:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f5bb05e3380 10000000:01000000:1.0:1788586808.992789:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586808.992798:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f5bb05e3380 from 1 10000000:01000000:1.0:1788586808.992800:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788586808.992844:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586808.992855:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586808.992865:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586808.992895:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385472:0@lo:101: 00000100:00100000:1.0:1788586808.992942:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586808.992993:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1364f8d going to sleep for 11 seconds 00000100:00100000:3.0:1788586808.993716:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385472 00000100:00100000:3.0:1788586808.993724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385472 00000100:00100000:3.0:1788586808.993769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586808.993825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f8d796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6498:x1875469127385472:12345-0@lo:101: 00010000:00010000:3.0:1788586808.993839:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586808.993853:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9393 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.993877:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.993888:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586808.993897:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009efe3bd8, rc 0) 00000100:00100000:3.0:1788586808.993958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f8d796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6498:x1875469127385472:12345-0@lo:101: Request processed in 136us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586808.993965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586808.994065:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385472:0@lo:101: 00010000:00010000:1.0:1788586808.994086:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586808.994095:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586808.994176:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385600:0@lo:501: 00000100:00100000:1.0:1788586808.997269:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586808.997390:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1364f8d going to sleep for 11 seconds 00000100:00100000:2.0:1788586809.000780:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385600 00000100:00100000:2.0:1788586809.000797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385600 00000100:00100000:2.0:1788586809.000867:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586809.000875:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8caf0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6498:x1875469127385600:12345-0@lo:501: 00000100:00100000:2.0:1788586809.001023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8caf0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6498:x1875469127385600:12345-0@lo:501: Request processed in 149us (4408us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788586809.001031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586809.004902:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385600:0@lo:501: 10000000:01000000:1.0:1788586809.004968:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788586809.004986:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.004998:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586809.005008:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5b86e73000 10000000:01000000:1.0:1788586809.005017:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788586809.005022:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f5b86e73000 10000000:01000000:1.0:1788586809.005025:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788586809.005028:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f5b86e73000 from 1 10000000:01000000:1.0:1788586809.005046:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788586809.005083:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.005092:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.005102:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586809.005122:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385728:0@lo:101: 00000100:00100000:1.0:1788586809.005200:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.005244:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385728 00000100:00100000:1.0:1788586809.005249:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385728 00000100:00100000:1.0:1788586809.005288:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586809.005296:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a2194eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6498:x1875469127385728:12345-0@lo:101: 00010000:00010000:1.0:1788586809.005307:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586809.005319:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c0a2321/0xfbc93bbea5fd93a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd93a1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.005339:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c0a2321/0xfbc93bbea5fd93a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd93a1 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.005349:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c0a2321/0xfbc93bbea5fd93a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd93a1 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.005358:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c0a2321, rc 0) 00000100:00100000:1.0:1788586809.005387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a2194eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+7:6498:x1875469127385728:12345-0@lo:101: Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.005394:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586809.008171:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1364f8d going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.008220:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385728:0@lo:101: 00010000:00010000:1.0:1788586809.008250:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.008263:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586809.008289:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788586809.008293:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.008300:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000000509fc4e/0xfbc93bbea5fd93a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586809.008308:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788586809.008314:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586809.008321:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f5b86e73000 10000000:01000000:1.0:1788586809.008324:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788586809.008328:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788586809.008331:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788586809.008361:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.008368:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.008376:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586809.008393:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385856:0@lo:101: 00000100:00100000:1.0:1788586809.008645:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.008680:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1364f8d going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.008750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385856 00000100:00100000:3.0:1788586809.008758:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385856 00000100:00100000:3.0:1788586809.008809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586809.008819:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d9062d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+7:6498:x1875469127385856:12345-0@lo:101: 00010000:00010000:3.0:1788586809.008837:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586809.008849:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd93af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.008869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.008878:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.008886:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002feeaa3a, rc 0) 00000100:00100000:3.0:1788586809.008923:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d9062d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+8:6498:x1875469127385856:12345-0@lo:101: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.008930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586809.009068:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385856:0@lo:101: 00010000:00010000:1.0:1788586809.009084:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.009091:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586809.009148:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385984:0@lo:501: 00000100:00100000:1.0:1788586809.009175:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.009203:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1364f8d going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.009300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127385984 00000100:00100000:3.0:1788586809.009305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127385984 00000100:00100000:3.0:1788586809.009335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586809.009342:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6952e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+8:6498:x1875469127385984:12345-0@lo:501: 00000100:00100000:3.0:1788586809.009498:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6952e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6498:x1875469127385984:12345-0@lo:501: Request processed in 157us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.009505:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788586809.009638:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7e3c841 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127385984:0@lo:501: 00000100:00100000:2.0:1788586809.009689:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e12fcec9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386112:0@lo:503: 00000100:00100000:2.0:1788586809.009744:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586809.009772:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045c9655d going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.009891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386112 00000100:00100000:3.0:1788586809.009896:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386112 00000100:00100000:3.0:1788586809.009922:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586809.009928:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bee0533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6498:x1875469127386112:12345-0@lo:503: 00000100:00100000:3.0:1788586809.010003:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bee0533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6498:x1875469127386112:12345-0@lo:503: Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.010010:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586809.010164:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e12fcec9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386112:0@lo:503: 00000100:00100000:2.0:1788586809.010627:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e12fcec9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6542:1875469127386240:0@lo:502: 00000100:00100000:2.0:1788586809.010672:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586809.010712:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e23b987c going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.012514:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386240 00000100:00100000:3.0:1788586809.012526:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386240 00000100:00100000:3.0:1788586809.012590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586809.012599:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a489ac0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6542:x1875469127386240:12345-0@lo:502: 00000100:00100000:3.0:1788586809.012771:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a489ac0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6542:x1875469127386240:12345-0@lo:502: Request processed in 174us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.012779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586809.013072:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e12fcec9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6542:1875469127386240:0@lo:502: 00000020:01000000:2.0:1788586809.013105:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586809.013117:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586809.013120:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788586809.013125:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788586809.013128:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788586809.013153:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000012f0f888) 00000020:00000080:2.0:1788586809.013170:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788586809.013177:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788586809.013319:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788586809.013325:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd93c4 00000020:00000080:1.0:1788586809.015825:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788586809.015837:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586809.015844:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586809.015846:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788586809.015849:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586809.015855:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586809.015857:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788586809.015860:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586809.015872:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000dc0b8ec4) 00000020:00000080:1.0:1788586809.015892:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788586809.015897:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788586809.015899:0:6542:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788586809.015902:0:6542:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788586809.015909:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788586809.016011:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e019e9f8 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788586809.016024:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000045c2d967) 00000020:00000080:1.0:1788586809.016033:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788586809.016106:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788586809.020049:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd93d9 00000020:00000080:1.0:1788586809.024727:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788586809.024744:0:6542:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788586809.024874:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfbc93bbea5fd93e0 00080000:01000000:1.0:1788586809.024892:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788586809.024897:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd93e7 00080000:10000000:1.0:1788586809.026661:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788586809.029854:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788586809.036887:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788586809.123730:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788586809.124136:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788586809.127383:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788586809.127951:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788586809.132924:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003a027163) 00000020:00000080:1.0:1788586809.132959:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788586809.133081:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788586809.133091:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd93f5 00000020:00000080:1.0:1788586809.134481:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788586809.138683:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788586809.146392:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788586809.149902:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788586809.152787:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788586809.156110:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788586809.158921:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788586809.161652:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfbc93bbea5fd93fc 00000020:00000080:2.0:1788586809.162235:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788586809.162248:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586809.162255:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586809.162257:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788586809.162260:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586809.162264:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586809.162265:0:6542:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788586809.162268:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788586809.162269:0:6542:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788586809.162272:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586809.162275:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586809.162275:0:6542:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788586809.162277:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586809.162282:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586809.162283:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788586809.162287:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788586809.162328:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788586809.162394:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e12fcec9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6542:1875469127386368:0@lo:502: 00000100:00100000:2.0:1788586809.162510:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586809.162612:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efe1c144 going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.162761:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386368 00000100:00100000:3.0:1788586809.162771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386368 00000100:00100000:3.0:1788586809.162912:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586809.162923:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca0720e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6542:x1875469127386368:12345-0@lo:502: 00000100:00100000:3.0:1788586809.163073:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca0720e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6542:x1875469127386368:12345-0@lo:502: Request processed in 151us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.163081:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586809.163173:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e12fcec9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6542:1875469127386368:0@lo:502: 00000020:01000000:2.0:1788586809.163203:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586809.163208:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586809.163210:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788586809.163213:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788586809.163491:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788586809.163516:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788586809.163533:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.163545:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586809.163554:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5b86e73000 from 1 10000000:01000000:0.0:1788586809.163558:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788586809.163607:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.163614:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.163623:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586809.163638:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386496:0@lo:101: 00000100:00100000:0.0:1788586809.163692:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.164138:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.164198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386496 00000100:00100000:1.0:1788586809.164206:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386496 00000100:00100000:2.0:1788586809.164256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586809.164265:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eca98d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:6498:x1875469127386496:12345-0@lo:101: 00010000:00010000:2.0:1788586809.164276:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586809.164299:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9403 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586809.164324:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586809.164334:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586809.164344:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f95715ec, rc 0) 00000100:00100000:2.0:1788586809.164391:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eca98d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:6498:x1875469127386496:12345-0@lo:101: Request processed in 127us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586809.164397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788586809.164511:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386496:0@lo:101: 00010000:00010000:0.0:1788586809.164524:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.164542:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586809.165231:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386624:0@lo:256: 00000100:00100000:0.0:1788586809.165280:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.165360:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.165500:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386624 00000100:00100000:3.0:1788586809.165507:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386624 00000100:00100000:3.0:1788586809.165540:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586809.165546:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f69a007c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:6498:x1875469127386624:12345-0@lo:256: 20000000:01000000:3.0:1788586809.165563:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788586809.165579:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788586809.165645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f69a007c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:6498:x1875469127386624:12345-0@lo:256: Request processed in 99us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.165660:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788586809.165867:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386624:0@lo:256: 10000000:01000000:0.0:1788586809.166541:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788586809.166559:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.166712:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586809.166721:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5b86e73000 from 1 10000000:01000000:0.0:1788586809.166725:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788586809.166763:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.166771:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.166780:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586809.166798:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386752:0@lo:101: 00000100:00100000:0.0:1788586809.167101:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.167249:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.167324:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386752 00000100:00100000:1.0:1788586809.167331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386752 00000100:00100000:1.0:1788586809.167365:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788586809.167372:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062d569d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:6498:x1875469127386752:12345-0@lo:101: 00010000:00010000:1.0:1788586809.167384:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586809.167398:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9411 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.167436:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.167446:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.167466:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013f8e754, rc 0) 00000100:00100000:1.0:1788586809.167509:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062d569d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127386752:12345-0@lo:101: Request processed in 137us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.167516:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586809.167691:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386752:0@lo:101: 00010000:00010000:0.0:1788586809.167718:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.167727:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586809.167792:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386880:0@lo:501: 00000100:00100000:0.0:1788586809.167832:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.167859:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.167967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127386880 00000100:00100000:1.0:1788586809.167982:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127386880 00000100:00100000:1.0:1788586809.168004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788586809.168010:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003234ae0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127386880:12345-0@lo:501: 00000100:00100000:1.0:1788586809.168182:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003234ae0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127386880:12345-0@lo:501: Request processed in 172us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.168190:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586809.168353:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127386880:0@lo:501: 00000100:00100000:0.0:1788586809.168384:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387008:0@lo:503: 00000100:00100000:0.0:1788586809.168463:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.168476:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.168541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387008 00000100:00100000:1.0:1788586809.168546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387008 00000100:00100000:1.0:1788586809.168564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788586809.168649:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f31a524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127387008:12345-0@lo:503: 00000040:00080000:1.0:1788586809.168683:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586809.168747:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f31a524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127387008:12345-0@lo:503: Request processed in 101us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.168754:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586809.168840:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387008:0@lo:503: 00000040:00080000:0.0:1788586809.170139:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788586809.170359:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788586809.170383:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586809.170406:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.170439:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586809.170517:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788586809.170520:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5b86e73000 10000000:01000000:1.0:1788586809.170524:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5b86e73000 10000000:01000000:1.0:1788586809.170528:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586809.170534:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5b86e73000 from 1 10000000:01000000:1.0:1788586809.170537:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586809.170588:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.170596:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.170606:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586809.170629:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f19abf35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387136:0@lo:101: 00000100:00100000:1.0:1788586809.170692:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.170744:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1364f8d going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.170764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387136 00000100:00100000:1.0:1788586809.170771:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387136 00000100:00100000:1.0:1788586809.170819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788586809.170827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6afae2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127387136:12345-0@lo:101: 00010000:00010000:1.0:1788586809.170840:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586809.170853:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd941f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.170879:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.170903:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.170913:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a10f6aa, rc 0) 00000100:00100000:1.0:1788586809.170952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6afae2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6498:x1875469127387136:12345-0@lo:101: Request processed in 126us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.170959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788586809.171217:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f19abf35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387136:0@lo:101: 00010000:00010000:1.0:1788586809.171235:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.171244:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586809.171298:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f19abf35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387264:0@lo:501: 00000100:00100000:1.0:1788586809.171325:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.171340:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a74dd5b going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.171354:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387264 00000100:00100000:1.0:1788586809.171357:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387264 00000100:00100000:1.0:1788586809.171388:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586809.171393:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a687aedc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6498:x1875469127387264:12345-0@lo:501: 00000100:00100000:1.0:1788586809.171536:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a687aedc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6498:x1875469127387264:12345-0@lo:501: Request processed in 143us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.171543:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586809.171637:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f19abf35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387264:0@lo:501: 00000100:00100000:1.0:1788586809.171665:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f19abf35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387392:0@lo:503: 00000100:00100000:1.0:1788586809.171716:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.171730:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a74dd5b going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.171744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387392 00000100:00100000:1.0:1788586809.171748:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387392 00000100:00100000:1.0:1788586809.171764:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788586809.171769:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2934fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6498:x1875469127387392:12345-0@lo:503: 00000100:00100000:1.0:1788586809.172078:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2934fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6498:x1875469127387392:12345-0@lo:503: Request processed in 308us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.172085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788586809.172287:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f19abf35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387392:0@lo:503: 00000100:00100000:0.0:1788586809.172837:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6547:1875469127387520:0@lo:502: 00000100:00100000:0.0:1788586809.172882:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.172908:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b68f0c4f going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.173063:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387520 00000100:00100000:1.0:1788586809.173071:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387520 00000100:00100000:1.0:1788586809.173113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788586809.173120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007162d272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6547:x1875469127387520:12345-0@lo:502: 00000100:00100000:1.0:1788586809.173234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007162d272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6547:x1875469127387520:12345-0@lo:502: Request processed in 114us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.173241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586809.173346:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6547:1875469127387520:0@lo:502: 00000020:01000004:0.0:1788586809.173410:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788586809.173467:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dee64250) 00000020:00000080:0.0:1788586809.173490:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788586809.173766:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e019e9f8 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788586809.173776:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e019e9f8 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788586809.173779:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e019e9f8 4 00010000:00080000:0.0:1788586809.173823:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d945be1e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788586809.178110:0:6547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788586809.178404:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788586809.178531:0:6547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788586809.178549:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfbc93bbea5fd9434 00000100:00080000:0.0:1788586809.178564:0:6547:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788586809.178643:0:6547:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d945be1e using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788586809.178694:0:6547:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001c01c149 x1875469127387648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788586809.178765:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127387648:0@lo:38: 00000100:00100000:3.0:1788586809.178880:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788586809.178958:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788586809.179676:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387648 00000100:00100000:3.0:1788586809.179687:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387648 00000100:00100000:3.0:1788586809.179770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586809.179779:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056ae5cd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127387648:12345-0@lo:38: 00000100:00100000:3.0:1788586809.179873:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056ae5cd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127387648:12345-0@lo:38: Request processed in 93us (994us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788586809.179880:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586809.180138:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586809.180149:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000d945be1e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788586809.180153:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788586809.180157:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c01c149 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127387648:0@lo:38: 00000100:00100000:1.0:1788586809.186784:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014fdd6e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6547:1875469127387776:0@lo:502: 00000100:00100000:1.0:1788586809.187498:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586809.187548:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016e020b7 going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.187740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387776 00000100:00100000:3.0:1788586809.187751:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387776 00000100:00100000:3.0:1788586809.187865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788586809.187876:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000470d7aac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6547:x1875469127387776:12345-0@lo:502: 00000100:00100000:3.0:1788586809.188756:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000470d7aac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6547:x1875469127387776:12345-0@lo:502: Request processed in 877us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.188766:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788586809.189082:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014fdd6e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:6547:1875469127387776:0@lo:502: 00000040:00080000:1.0:1788586809.189122:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788586809.189305:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788586809.189333:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586809.189358:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586809.189370:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788586809.189461:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788586809.189464:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586809.189466:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586809.189467:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586809.189468:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586809.189470:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586809.189471:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586809.189472:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586809.189474:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586809.189475:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586809.189477:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586809.189478:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788586809.189488:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788586809.189491:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788586809.189492:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586809.189493:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586809.189493:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586809.189494:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586809.189495:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586809.189496:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586809.189497:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586809.189498:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586809.189498:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586809.189499:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586809.189500:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788586809.189527:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788586809.189543:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090c4d534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387904:0@lo:253: 00000100:00100000:0.0:1788586809.189763:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586809.190140:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055d6c58e going to sleep for 11 seconds 00000100:00100000:3.0:1788586809.190947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127387904 00000100:00100000:3.0:1788586809.190959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127387904 00000100:00100000:3.0:1788586809.191122:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586809.191133:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020aa6ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6498:x1875469127387904:12345-0@lo:253: 20000000:01000000:3.0:1788586809.191172:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788586809.191188:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788586809.198957:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788586809.198980:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788586809.199208:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788586809.199215:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788586809.199242:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.199285:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.199294:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.199341:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.199359:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 12 pid: 6516 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586809.199376:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005746a28 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127388032:0@lo:104: 00000100:00100000:3.0:1788586809.199486:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586809.199544:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 000000000fea313f going to sleep for 11 seconds 00000100:00100000:1.0:1788586809.199632:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388032 00000100:00100000:1.0:1788586809.199643:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388032 00000100:00100000:1.0:1788586809.199708:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586809.199717:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073a1711e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127388032:12345-0@lo:104: 00010000:00010000:1.0:1788586809.199732:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586809.199801:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788586809.199820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073a1711e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127388032:12345-0@lo:104: Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586809.199829:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586809.200019:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005746a28 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127388032:0@lo:104: 00010000:00010000:3.0:1788586809.200039:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200058:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586809.200063:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200070:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e16cef5 already unused, calling callback (00000000a1a57611) 10000000:00010000:3.0:1788586809.200073:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200081:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586809.200111:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586809.200116:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586809.200155:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200162:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586809.200181:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200187:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd9403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd940a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200208:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586809.200209:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586809.200211:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586809.200277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005746a28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127388160:0@lo:103: 00000100:00100000:3.0:1788586809.200309:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586809.200386:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388160 00000100:00100000:3.0:1788586809.200391:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388160 00010000:00010000:3.0:1788586809.200408:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 13 pid: 6516 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586809.200458:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586809.200465:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028987e1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3647:x1875469127388160:12345-0@lo:103: 00010000:00010000:3.0:1788586809.200476:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586809.200480:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 13 pid: 6516 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200496:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 13 pid: 6516 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200508:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f95715ec/0xfbc93bbea5fd940a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9403 expref: 13 pid: 6516 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200521:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200528:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788586809.200541:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001328038s 00010000:00010000:3.0:1788586809.200544:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200550:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200556:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200562:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200580:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9e8f797 already unused, calling callback (0000000085c85942) 00010000:00010000:3.0:1788586809.200584:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200592:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200610:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200620:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586809.200649:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028987e1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3647:x1875469127388160:12345-0@lo:103: Request processed in 186us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586809.200656:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788586809.200676:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200683:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586809.200688:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9e8f797/0xfbc93bbea5fd943b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586809.200726:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005746a28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127388160:0@lo:103: 00000100:00100000:2.0:1788586809.201184:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020aa6ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6498:x1875469127387904:12345-0@lo:253: Request processed in 10051us (11419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586809.201193:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586809.201439:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090c4d534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:6498:1875469127387904:0@lo:253: 10000000:01000000:3.0:1788586809.201452:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788586809.201455:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788586809.201457:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788586809.201458:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586809.201460:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586809.201461:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586809.201462:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586809.201463:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586809.201464:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788586809.201466:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586809.201467:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586809.201469:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586809.201470:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788586809.201490:0:6498:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788586809.209203:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788586809.209398:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788586809.210016:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788586809.210208:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788586809.210411:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788586809.210720:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788586809.215142:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788586809.215346:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788586809.216317:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788586809.216757:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788586809.217176:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788586809.217365:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788586809.222012:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788586809.241326:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788586809.241879:0:6552:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788586809.241885:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788586809.242253:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1788586809.252498:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788586809.257522:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788586809.258823:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788586809.259889:0:6498:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788586809.259909:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788586809.260127:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788586809.263614:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788586809.263722:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788586809.263727:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788586809.263913:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788586809.265224:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788586809.265302:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788586809.265979:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788586809.266758:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788586809.268825:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788586809.268997:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788586809.269373:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788586809.269579:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788586809.269742:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788586809.269891:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788586809.270049:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788586809.270925:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788586809.271086:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788586809.271379:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788586809.271910:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788586809.272051:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788586809.273801:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788586809.273975:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788586809.274136:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788586809.274397:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788586809.275008:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788586809.275312:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788586809.275951:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788586809.276106:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788586809.276313:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788586809.276658:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788586809.276799:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788586809.276936:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788586809.277048:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788586809.278399:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788586809.278788:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788586809.278943:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788586809.279081:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788586809.279275:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788586809.279471:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788586809.279633:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788586809.280001:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788586809.285648:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788586809.285714:0:6498:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacde419ab988 00100000:10000000:1.0:1788586809.285724:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788586809.291085:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788586809.291112:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788586809.291146:0:6498:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788586809.291185:0:6498:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788586809.292189:0:6498:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788586809.292754:0:6498:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788586809.814537:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586810.841625:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586811.860747:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586812.884718:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586813.912775:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788586813.956697:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788586814.292763:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:3.0:1788586814.292929:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586814.292949:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014fdd6e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127388288:0@lo:400: 00000100:00100000:3.0:1788586814.293030:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586814.293110:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388288 00000100:00100000:3.0:1788586814.293118:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388288 00000100:00100000:3.0:1788586814.293164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586814.293173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0cb0fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:3649:x1875469127388288:12345-0@lo:400: 00000100:00100000:3.0:1788586814.293228:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0cb0fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:3649:x1875469127388288:12345-0@lo:400: Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586814.293235:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586814.293283:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014fdd6e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127388288:0@lo:400: 00000100:00080000:1.0:1788586814.293991:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788586814.293995:0:36:0:(import.c:65:import_set_state_nolock()) 00000000d945be1e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788586814.294005:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d945be1e using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788586814.294549:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bfa52208 x1875469127388416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788586814.294851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfa52208 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127388416:0@lo:38: 00000100:00100000:2.0:1788586814.294913:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586814.295167:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388416 00000100:00100000:0.0:1788586814.295175:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388416 00000100:00100000:0.0:1788586814.295220:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586814.295226:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e12fcec9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875469127388416:12345-0@lo:38: 00010000:00080000:0.0:1788586814.295264:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1788586814.295301:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfbc93bbea5fd9442 00000004:00100000:0.0:1788586814.295348:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788586814.296942:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000fded8e0e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586814.297039:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e12fcec9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875469127388416:12345-0@lo:38: Request processed in 1809us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586814.297050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788586814.297643:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bfa52208 x1875469127388416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788586814.297662:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788586814.297681:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788586814.297686:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788586814.297688:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000d945be1e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788586814.297694:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfa52208 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127388416:0@lo:38: 00000020:00000004:2.0:1788586814.859100:0:6850:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788586814.859349:0:6850:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788586814.933592:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586815.956735:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788586816.340906:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788586816.340917:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5b86e73000 from 3 10000000:01000000:1.0:1788586816.340922:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788586816.340987:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586816.341001:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586816.341013:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586816.341042:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000faa9525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127388544:0@lo:101: 00000100:00100000:1.0:1788586816.341304:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586816.341390:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000005bbf15f7 going to sleep for 11 seconds 00000100:00100000:2.0:1788586816.341580:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388544 00000100:00100000:2.0:1788586816.341591:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388544 00000100:00100000:2.0:1788586816.341660:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586816.341670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fc7e301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6518:x1875469127388544:12345-0@lo:101: 00010000:00010000:2.0:1788586816.341684:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586816.341701:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9449 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586816.341729:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586816.341740:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586816.341786:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f5d9548, rc 0) 00000100:00100000:2.0:1788586816.341844:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fc7e301 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127388544:12345-0@lo:101: Request processed in 175us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586816.341851:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788586816.342598:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000faa9525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127388544:0@lo:101: 00010000:00010000:1.0:1788586816.342631:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586816.342643:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586816.342717:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000faa9525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127388672:0@lo:256: 00000100:00100000:1.0:1788586816.342838:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586816.342878:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 000000005bbf15f7 going to sleep for 11 seconds 00000100:00100000:0.0:1788586816.343201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388672 00000100:00100000:0.0:1788586816.343209:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388672 00000100:00100000:0.0:1788586816.343262:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788586816.343271:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1fab25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127388672:12345-0@lo:256: 20000000:01000000:0.0:1788586816.343294:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788586816.343314:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788586816.343318:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788586816.344936:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1fab25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127388672:12345-0@lo:256: Request processed in 1654us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586816.344951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586816.351485:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000faa9525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127388672:0@lo:256: 10000000:01000000:1.0:1788586816.351577:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788586816.351588:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586816.351600:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586816.984036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586818.004541:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788586818.019033:0:6951:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788586818.019268:0:6951:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788586819.031989:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586819.414856:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000faa9525 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127388800:0@lo:400: 00000100:00100000:3.0:1788586819.414942:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586819.415061:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e699541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127388928:0@lo:400: 00000100:00100000:2.0:1788586819.416244:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388800 00000100:00100000:2.0:1788586819.416256:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388800 00000100:00100000:2.0:1788586819.418235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788586819.418257:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd02c611 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3649:x1875469127388800:12345-0@lo:400: 00000100:00100000:2.0:1788586819.419436:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd02c611 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3649:x1875469127388800:12345-0@lo:400: Request processed in 1166us (4473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586819.419448:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586819.419709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000faa9525 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127388800:0@lo:400: 00000100:00100000:1.0:1788586819.420044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586819.427463:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127388928 00000100:00100000:3.0:1788586819.427477:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127388928 00000100:00100000:3.0:1788586819.427532:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586819.427541:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038150e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127388928:12345-0@lo:400: 00000100:00100000:3.0:1788586819.427667:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038150e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127388928:12345-0@lo:400: Request processed in 126us (12551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586819.427686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788586819.430294:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002e699541 x1875469127388928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586819.430316:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e699541 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127388928:0@lo:400: 00010000:00010000:2.0:1788586820.053552:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586821.076726:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586822.100841:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586823.125746:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586824.149541:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586824.538436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005746a28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127389056:0@lo:400: 00000100:00100000:3.0:1788586824.538520:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586824.538740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127389184:0@lo:400: 00000100:00100000:3.0:1788586824.538774:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586824.539451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389056 00000100:00100000:3.0:1788586824.539460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389056 00000100:00100000:3.0:1788586824.539509:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788586824.539518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056a98a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3647:x1875469127389056:12345-0@lo:400: 00000100:00100000:3.0:1788586824.539973:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056a98a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3647:x1875469127389056:12345-0@lo:400: Request processed in 454us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586824.539982:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788586824.540021:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389184 00000100:00100000:3.0:1788586824.540025:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389184 00000100:00100000:3.0:1788586824.540053:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586824.540059:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c0a250b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127389184:12345-0@lo:400: 00000100:00100000:3.0:1788586824.540099:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c0a250b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127389184:12345-0@lo:400: Request processed in 41us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586824.540105:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586824.540282:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005746a28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127389056:0@lo:400: 00010000:00080000:3.0:1788586824.540322:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c8620794 x1875469127389184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586824.540349:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127389184:0@lo:400: 00010000:00010000:1.0:1788586825.177042:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586826.198814:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586827.233682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788586828.136542:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788586828.136549:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788586828.136550:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788586828.136727:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002e240f84 00000020:01000004:1.0:1788586828.136751:0:7450:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788586828.136764:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788586828.136779:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e2e58461) 00000020:00000080:1.0:1788586828.136796:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788586828.200112:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788586828.200197:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788586828.226127:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788586828.226358:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788586828.226369:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788586828.227524:0:7450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fd945e 00000020:01000004:2.0:1788586828.227537:0:7450:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788586828.227561:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788586828.227564:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788586828.227578:0:7450:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788586828.227612:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788586828.227616:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:2.0:1788586828.245511:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788586828.250329:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788586828.250369:0:7450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.101@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788586828.250373:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788586828.250375:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586828.250377:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586828.250378:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586828.250379:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586828.250380:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586828.250382:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586828.250383:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586828.250384:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586828.250386:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586828.250387:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788586828.250391:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788586828.250393:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788586828.250394:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586828.250395:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586828.250396:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586828.250397:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586828.250398:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586828.250399:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586828.250400:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586828.250401:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586828.250402:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586828.250403:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788586828.250531:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788586828.250549:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127389312:0@lo:253: 00000100:00100000:3.0:1788586828.250638:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.250731:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005d4498f going to sleep for 11 seconds 00000100:00100000:2.0:1788586828.250838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389312 00000100:00100000:2.0:1788586828.250846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389312 00000100:00100000:2.0:1788586828.250933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788586828.250942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000987c34a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127389312:12345-0@lo:253: 20000000:01000000:2.0:1788586828.250984:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788586828.250988:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788586828.251004:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788586828.251007:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788586828.251060:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788586828.251280:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586828.251455:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788586828.251471:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788586828.251489:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788586828.251505:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788586828.251520:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788586828.251593:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788586828.251601:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788586828.251616:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788586828.251622:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788586828.251634:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788586828.251640:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788586828.251662:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788586828.251678:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788586828.251834:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788586828.251844:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:2.0:1788586828.251859:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788586828.251866:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788586828.251880:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788586828.251886:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:2.0:1788586828.251899:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788586828.251913:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788586828.251929:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788586828.251948:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788586828.251959:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788586828.252043:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788586828.252054:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788586828.252066:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788586828.252081:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788586828.252098:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788586828.252104:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788586828.252118:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788586828.252141:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788586828.252147:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788586828.252167:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788586828.252174:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788586828.252556:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788586828.252679:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788586828.252699:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.101@tcp for mdt 20000000:01000000:2.0:1788586828.252700:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:2.0:1788586828.252716:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788586828.252722:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788586828.252733:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788586828.252738:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:2.0:1788586828.252765:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788586828.252774:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788586828.252788:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788586828.252803:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788586828.252840:0:6516:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788586828.252848:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788586828.253199:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788586828.253368:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788586828.253383:0:6516:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.101@tcp for mdt 20000000:01000000:2.0:1788586828.253385:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:2.0:1788586828.253413:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788586828.254001:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788586828.254114:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788586828.254121:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:3.0:1788586828.254131:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788586828.254142:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788586828.254151:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788586828.254160:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788586828.254175:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788586828.254177:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788586828.254181:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788586828.254272:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788586828.254274:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788586828.254903:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788586828.254938:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788586828.254952:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788586828.255173:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788586828.255187:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788586828.255209:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788586828.255223:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788586828.255225:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788586828.255535:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788586828.255554:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788586828.255566:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788586828.255793:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788586828.255813:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788586828.255837:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788586828.255846:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788586828.255848:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788586828.256108:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788586828.256128:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788586828.256142:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788586828.256274:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788586828.256295:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788586828.256309:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788586828.256321:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788586828.256324:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788586828.256329:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788586828.256337:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788586828.256833:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788586828.257111:0:6516:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788586828.263746:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788586828.264223:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.264240:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.264245:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.264249:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.264267:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.264304:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.264314:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 12 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.264325:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006eeea868 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875469127389440:0@lo:104: 00000100:00100000:0.0:1788586828.264394:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586828.264994:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.265004:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 12 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.265027:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875469127389568:0@lo:104: 00000100:00100000:0.0:1788586828.265054:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586828.265330:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.265339:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 12 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.265348:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875469127389696:0@lo:104: 00000100:00100000:0.0:1788586828.265371:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.265431:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389440 00000100:00100000:3.0:1788586828.265439:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389440 00000100:00100000:3.0:1788586828.265480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389568 00000100:00100000:3.0:1788586828.265482:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389568 00000100:00100000:3.0:1788586828.265497:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586828.265504:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3dad779 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6516:x1875469127389440:12345-0@lo:104: 00010000:00010000:3.0:1788586828.265525:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.265586:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586828.265591:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3dad779 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6516:x1875469127389440:12345-0@lo:104: Request processed in 88us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.265599:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586828.265615:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586828.265621:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003962f181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6516:x1875469127389568:12345-0@lo:104: 00010000:00010000:3.0:1788586828.265629:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.265659:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586828.265663:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003962f181 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6516:x1875469127389568:12345-0@lo:104: Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.265669:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586828.265910:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096d3f79c going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.265932:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006eeea868 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875469127389440:0@lo:104: 00000100:00100000:0.0:1788586828.265950:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875469127389568:0@lo:104: 00000100:00100000:3.0:1788586828.265995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389696 00000100:00100000:3.0:1788586828.265999:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389696 00000100:00100000:3.0:1788586828.266017:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586828.266021:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029675dc2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6516:x1875469127389696:12345-0@lo:104: 00010000:00010000:2.0:1788586828.266026:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586828.266028:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266032:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266039:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7b9d311 already unused, calling callback (00000000a1a57611) 10000000:00010000:2.0:1788586828.266042:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266049:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586828.266056:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586828.266061:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586828.266067:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586828.266071:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029675dc2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6516:x1875469127389696:12345-0@lo:104: Request processed in 50us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.266077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788586828.266091:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266098:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586828.266123:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266130:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 00000000f7b9d311/0xfbc93bbea5fd941f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9426 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.266135:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875469127389696:0@lo:104: 00010000:00010000:2.0:1788586828.266147:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586828.266149:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266153:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b798d1af already unused, calling callback (00000000a1a57611) 00010000:00010000:0.0:1788586828.266154:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586828.266155:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266161:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586828.266167:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586828.266172:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586828.266184:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266191:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788586828.266204:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099809e35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127389824:0@lo:103: 00010000:00010000:2.0:1788586828.266212:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266218:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 00000000b798d1af/0xfbc93bbea5fd93af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd93b6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266225:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586828.266227:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.266239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586828.266241:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c100a07 already unused, calling callback (00000000a1a57611) 10000000:00010000:2.0:1788586828.266243:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266249:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586828.266254:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586828.266259:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586828.266271:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266276:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788586828.266278:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389824 00010000:00010000:2.0:1788586828.266280:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.266281:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389824 00010000:00010000:2.0:1788586828.266285:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 000000009c100a07/0xfbc93bbea5fd9393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd939a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.266296:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266298:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586828.266299:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586828.266301:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586828.266315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9d6a72f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127390080:0@lo:103: 00000100:00100000:3.0:1788586828.266316:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586828.266321:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005746a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3649:x1875469127389824:12345-0@lo:103: 00000100:00100000:2.0:1788586828.266343:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586828.266345:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586828.266350:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.266360:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.266361:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586828.266365:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5740bfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127389952:0@lo:103: 00010000:00010000:3.0:1788586828.266371:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003a10f6aa/0xfbc93bbea5fd9426 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd941f expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.266382:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586828.266395:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.266403:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005746a28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3649:x1875469127389824:12345-0@lo:103: Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.266409:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586828.266428:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390080 00000100:00100000:2.0:1788586828.266431:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390080 00000100:00100000:3.0:1788586828.266434:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127389952 00000100:00100000:3.0:1788586828.266437:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127389952 00010000:00010000:3.0:1788586828.266444:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.266444:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.266456:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586828.266460:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b975032b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3647:x1875469127389952:12345-0@lo:103: 00010000:00010000:3.0:1788586828.266521:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586828.266533:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.266541:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.266549:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd93b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd93af expref: 13 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.266558:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586828.266635:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b975032b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3647:x1875469127389952:12345-0@lo:103: Request processed in 174us (240us total) trans 0 rc 0/0 00010000:00010000:1.0:1788586828.266737:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586828.266859:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5740bfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127389952:0@lo:103: 00000100:00100000:2.0:1788586828.267014:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586828.267023:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019482371 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3647:x1875469127390080:12345-0@lo:103: 00010000:00010000:2.0:1788586828.267031:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586828.267034:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 12 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267042:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 12 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267064:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009efe3bd8/0xfbc93bbea5fd939a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9393 expref: 12 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267075:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267083:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.267090:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788586828.267157:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267164:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267170:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.267172:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099809e35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127389824:0@lo:103: 00010000:00010000:2.0:1788586828.267181:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267187:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043909127 already unused, calling callback (0000000085c85942) 00010000:00010000:2.0:1788586828.267189:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267197:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267216:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.267225:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586828.267258:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.267259:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019482371 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:3647:x1875469127390080:12345-0@lo:103: Request processed in 239us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.267265:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788586828.267265:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.267270:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000043909127/0xfbc93bbea5fd9465 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586828.267287:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788586828.269224:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000987c34a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:7450:x1875469127389312:12345-0@lo:253: Request processed in 18274us (18578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.269239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788586828.269322:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127389312:0@lo:253: 10000000:01000000:3.0:1788586828.269338:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788586828.269341:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788586828.269343:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788586828.269344:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586828.269345:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788586828.269346:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586828.269347:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586828.269348:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586828.269349:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788586828.269350:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586828.269351:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788586828.269369:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002e240f84 from lustre-MDT0001 10000000:01000000:3.0:1788586828.269399:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788586828.269403:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788586828.269410:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f5bb05e3380 local copy 10000000:01000000:3.0:1788586828.269440:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788586828.269471:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.269491:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.269500:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.269521:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390208:0@lo:101: 00000100:00100000:3.0:1788586828.269558:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.269599:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390208 00000100:00100000:3.0:1788586828.269600:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cebcb5e going to sleep for 11 seconds 00000100:00100000:2.0:1788586828.269605:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390208 00000100:00100000:2.0:1788586828.269661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586828.269669:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ef9f13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:7450:x1875469127390208:12345-0@lo:101: 00010000:00010000:2.0:1788586828.269681:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586828.269693:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fe80152/0xfbc93bbea5fd9473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd946c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.269713:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fe80152/0xfbc93bbea5fd9473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd946c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.269723:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fe80152/0xfbc93bbea5fd9473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd946c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.269737:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fe80152, rc 0) 00000100:00100000:1.0:1788586828.269753:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9d6a72f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127390080:0@lo:103: 00000100:00100000:2.0:1788586828.269772:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ef9f13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:7450:x1875469127390208:12345-0@lo:101: Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.269777:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788586828.269870:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390208:0@lo:101: 00010000:00010000:3.0:1788586828.269881:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.269890:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.269975:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390336:0@lo:501: 00000100:00100000:3.0:1788586828.270000:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.270023:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cebcb5e going to sleep for 11 seconds 00000100:00100000:1.0:1788586828.270096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390336 00000100:00100000:1.0:1788586828.270101:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390336 00000100:00100000:1.0:1788586828.270131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788586828.270137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1892e75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:7450:x1875469127390336:12345-0@lo:501: 00000100:00100000:1.0:1788586828.270199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1892e75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:7450:x1875469127390336:12345-0@lo:501: Request processed in 62us (198us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788586828.270206:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788586828.270221:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8620794 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390336:0@lo:501: 10000000:01000000:2.0:1788586828.270232:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788586828.270250:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788586828.270254:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.270262:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.270268:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.270290:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788586828.270312:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5baaa5e000 10000000:01000000:2.0:1788586828.270317:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788586828.270321:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f5bb05e3380 10000000:01000000:2.0:1788586828.270323:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788586828.270326:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f5bb05e3380 from 1 10000000:01000000:2.0:1788586828.270328:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788586828.270330:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586828.270336:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.270343:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.270343:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076791a56 already unused, calling callback (00000000a1a57611) 10000000:00010000:0.0:1788586828.270345:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.270349:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.270353:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.270361:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586828.270369:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.270372:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e653f839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390464:0@lo:101: 10000000:01000000:0.0:1788586828.270375:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788586828.270391:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.270397:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788586828.270407:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586828.270439:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.270446:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 0000000076791a56/0xfbc93bbea5fd946c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd9473 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.270450:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b695dd7b going to sleep for 11 seconds 00010000:00010000:0.0:1788586828.270459:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586828.270461:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586828.270463:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586828.270468:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586828.270476:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127390592:0@lo:103: 00000100:00100000:0.0:1788586828.270507:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.270635:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390592 00000100:00100000:2.0:1788586828.270640:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390592 00000100:00100000:2.0:1788586828.271025:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586828.271033:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f2d1a90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:3649:x1875469127390592:12345-0@lo:103: 00010000:00010000:2.0:1788586828.271068:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586828.271081:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fe80152/0xfbc93bbea5fd9473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd946c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.271092:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586828.271139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f2d1a90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:3649:x1875469127390592:12345-0@lo:103: Request processed in 108us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.271146:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586828.271339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127390592:0@lo:103: 00000100:00100000:1.0:1788586828.271407:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390464 00000100:00100000:1.0:1788586828.271412:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390464 00000100:00100000:2.0:1788586828.272908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788586828.272918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbceee66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:7450:x1875469127390464:12345-0@lo:101: 00010000:00010000:2.0:1788586828.272932:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586828.272948:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039cea2ba/0xfbc93bbea5fd9481 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd947a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.272980:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039cea2ba/0xfbc93bbea5fd9481 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd947a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.273013:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039cea2ba/0xfbc93bbea5fd9481 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd947a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.273022:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039cea2ba, rc 0) 00000100:00100000:2.0:1788586828.273126:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbceee66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:7450:x1875469127390464:12345-0@lo:101: Request processed in 211us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.273134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586828.273206:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e653f839 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390464:0@lo:101: 00010000:00010000:3.0:1788586828.273223:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.273232:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586828.273254:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788586828.273280:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.273287:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000f95715ec/0xfbc93bbea5fd947a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586828.273298:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f5baaa5e000 10000000:01000000:3.0:1788586828.273303:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788586828.273307:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f5baaa5e000 from 1 10000000:01000000:3.0:1788586828.273310:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788586828.273333:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.273339:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.273345:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.273364:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390720:0@lo:101: 00000100:00100000:3.0:1788586828.273452:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.274908:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ee05775 going to sleep for 11 seconds 00000100:00100000:1.0:1788586828.274960:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390720 00000100:00100000:1.0:1788586828.274968:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390720 00000100:00100000:1.0:1788586828.275010:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788586828.275019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e8494ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:7450:x1875469127390720:12345-0@lo:101: 00010000:00010000:1.0:1788586828.275032:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586828.275046:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db71381b/0xfbc93bbea5fd948f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9488 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586828.275081:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db71381b/0xfbc93bbea5fd948f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9488 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586828.275090:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db71381b/0xfbc93bbea5fd948f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9488 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586828.275098:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db71381b, rc 0) 00000100:00100000:1.0:1788586828.275157:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e8494ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:7450:x1875469127390720:12345-0@lo:101: Request processed in 139us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586828.275164:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586828.275186:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390720:0@lo:101: 00010000:00010000:3.0:1788586828.275201:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.275210:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586828.275223:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788586828.275244:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.275250:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000b9e8f797/0xfbc93bbea5fd9488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586828.275258:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788586828.275262:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788586828.275267:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f5baaa5e000 10000000:01000000:3.0:1788586828.275269:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788586828.275272:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788586828.275274:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788586828.275294:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.275300:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.275306:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.275319:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390848:0@lo:101: 00000100:00100000:3.0:1788586828.275346:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.275363:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ee05775 going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.275987:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390848 00000100:00100000:0.0:1788586828.275993:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390848 00000100:00100000:0.0:1788586828.276034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788586828.276041:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038fa232b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:7450:x1875469127390848:12345-0@lo:101: 00010000:00010000:0.0:1788586828.276049:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586828.276068:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043909127/0xfbc93bbea5fd949d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9496 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.276099:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043909127/0xfbc93bbea5fd949d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.276107:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043909127/0xfbc93bbea5fd949d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.276114:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043909127, rc 0) 00000100:00100000:0.0:1788586828.276149:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038fa232b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127390848:12345-0@lo:101: Request processed in 109us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.276154:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586828.276359:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390848:0@lo:101: 00010000:00010000:3.0:1788586828.276370:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.276386:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.276820:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390976:0@lo:501: 00000100:00100000:3.0:1788586828.276854:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.276951:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ee05775 going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.276996:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127390976 00000100:00100000:0.0:1788586828.277001:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127390976 00000100:00100000:0.0:1788586828.277034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788586828.277041:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098c6d137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127390976:12345-0@lo:501: 00000100:00100000:0.0:1788586828.277280:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098c6d137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127390976:12345-0@lo:501: Request processed in 239us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.277286:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586828.278349:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127390976:0@lo:501: 00000100:00100000:3.0:1788586828.278564:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391104:0@lo:503: 00000100:00100000:3.0:1788586828.278750:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.278785:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ee05775 going to sleep for 11 seconds 00000100:00100000:2.0:1788586828.278977:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391104 00000100:00100000:2.0:1788586828.278984:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391104 00000100:00100000:2.0:1788586828.279031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788586828.279039:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab87c858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391104:12345-0@lo:503: 00000100:00100000:2.0:1788586828.279156:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab87c858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391104:12345-0@lo:503: Request processed in 118us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.279164:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788586828.279335:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391104:0@lo:503: 00000040:00080000:3.0:1788586828.279961:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788586828.280038:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391232:0@lo:502: 00000100:00100000:3.0:1788586828.280250:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.280320:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ee05775 going to sleep for 11 seconds 00000100:00100000:2.0:1788586828.280992:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391232 00000100:00100000:2.0:1788586828.280999:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391232 00000100:00100000:2.0:1788586828.281042:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788586828.281049:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000883a2fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391232:12345-0@lo:502: 00000100:00100000:2.0:1788586828.281335:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000883a2fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391232:12345-0@lo:502: Request processed in 287us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.281344:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586828.281776:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391232:0@lo:502: 00000040:00080000:3.0:1788586828.282826:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788586828.282874:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788586828.282961:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788586828.282981:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788586828.282995:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788586828.283009:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788586828.283023:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788586828.283037:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788586828.283173:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788586828.283194:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788586828.283209:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788586828.283223:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788586828.283235:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788586828.283257:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788586828.283272:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788586828.283289:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788586828.283304:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788586828.283318:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788586828.283333:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788586828.283347:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788586828.283360:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788586828.283567:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788586828.283600:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788586828.283761:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391360:0@lo:502: 00000100:00100000:3.0:1788586828.283840:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.283995:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ee05775 going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.284052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391360 00000100:00100000:0.0:1788586828.284179:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391360 00000100:00100000:0.0:1788586828.284284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586828.284293:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000921aa94f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391360:12345-0@lo:502: 00000100:00100000:0.0:1788586828.284445:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000921aa94f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391360:12345-0@lo:502: Request processed in 153us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.284453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586828.284542:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391360:0@lo:502: 00000040:00080000:3.0:1788586828.284607:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788586828.284618:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788586828.285357:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586828.285368:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586828.285370:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788586828.285383:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788586828.285386:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788586828.285411:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000007d1db745) 00000020:00000080:3.0:1788586828.285454:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788586828.285461:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788586828.285568:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788586828.285583:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fd94ab 00000020:00000080:3.0:1788586828.286067:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788586828.286072:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586828.286076:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586828.286077:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788586828.286080:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586828.286090:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586828.286092:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788586828.286108:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788586828.286115:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000219d07f4) 00000020:00000080:3.0:1788586828.286126:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788586828.286130:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788586828.286132:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788586828.286135:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788586828.286141:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788586828.286208:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002e240f84 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788586828.286221:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000c97083a1) 00000020:00000080:3.0:1788586828.286230:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788586828.286280:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788586828.286285:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd94c0 00000020:00000080:3.0:1788586828.286365:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788586828.286371:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788586828.286385:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xfbc93bbea5fd94c7 00080000:01000000:3.0:1788586828.286390:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788586828.286393:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fd94ce 00080000:10000000:3.0:1788586828.287221:0:7462:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788586828.287516:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788586828.394020:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788586828.395795:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788586828.398026:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788586828.398585:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788586828.409761:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788586828.409779:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586828.409787:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586828.409789:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788586828.409793:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586828.409800:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586828.409807:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788586828.409811:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788586828.409817:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:00000080:2.0:1788586828.409850:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788586828.409868:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000011e1347) 00000020:00000080:2.0:1788586828.409895:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788586828.409902:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788586828.409986:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788586828.409993:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788586828.410001:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fd94dc 00010000:00080000:2.0:1788586828.410036:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b5426203@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:2.0:1788586828.412954:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788586828.415046:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788586828.415066:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788586828.415112:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788586828.415144:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd94e3 00000100:00080000:1.0:1788586828.415157:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586828.415163:0:7462:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000b5426203 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586828.415200:0:7462:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c61b305f x1875469127391488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586828.415226:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788586828.415290:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586828.415294:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586828.415296:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788586828.415298:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788586828.415309:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788586828.415311:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788586828.415312:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788586828.415314:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788586828.415316:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586828.415318:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788586828.415320:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586828.415324:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586828.415326:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788586828.415330:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788586828.415363:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788586828.415374:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586828.415377:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586828.415378:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788586828.415380:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586828.415383:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586828.415384:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788586828.415386:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788586828.415387:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788586828.415443:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586828.415447:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586828.415449:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788586828.415451:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788586828.415752:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788586828.415767:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127391616:0@lo:400: 00000100:00100000:0.0:1788586828.415855:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.415919:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391616 00000100:00100000:0.0:1788586828.415926:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391616 00000100:00100000:0.0:1788586828.415969:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586828.415976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eeea868 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127391616:12345-0@lo:400: 00000100:00100000:0.0:1788586828.416027:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eeea868 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127391616:12345-0@lo:400: Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.416035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788586828.416072:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005220c490 x1875469127391616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586828.416084:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127391616:0@lo:400: 00000100:00100000:2.0:1788586828.416260:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c61b305f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127391488:0@lo:38: 00000100:00100000:2.0:1788586828.416309:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788586828.416361:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788586828.416394:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788586828.416439:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.416449:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000004d6a2bd6/0xfbc93bbea5fd9496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586828.416458:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5baaa5e000 from 1 10000000:01000000:2.0:1788586828.416461:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788586828.416485:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.416492:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586828.416609:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391488 00000100:00100000:1.0:1788586828.416615:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391488 00000100:00100000:1.0:1788586828.416647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586828.416652:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041100217 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875469127391488:12345-0@lo:38: 00010000:00080000:1.0:1788586828.416671:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788586828.416708:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd94f1 00000004:00100000:1.0:1788586828.416724:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788586828.416730:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788586828.416869:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.416893:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391744:0@lo:101: 00000100:00100000:2.0:1788586828.416933:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.416950:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcda916b going to sleep for 11 seconds 00000100:00100000:2.0:1788586828.416972:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391744 00000100:00100000:2.0:1788586828.416975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391744 00000100:00100000:2.0:1788586828.417013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788586828.417019:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d267d11c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:7450:x1875469127391744:12345-0@lo:101: 00010000:00010000:2.0:1788586828.417029:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586828.417041:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd94ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.417062:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.417072:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.417080:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b467a40, rc 0) 00000100:00100000:2.0:1788586828.417109:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d267d11c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:7450:x1875469127391744:12345-0@lo:101: Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.417115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788586828.417169:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391744:0@lo:101: 00010000:00010000:2.0:1788586828.417182:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.417191:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.418072:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391872:0@lo:256: 00000100:00100000:2.0:1788586828.418123:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.418160:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcda916b going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.418494:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127391872 00000100:00100000:0.0:1788586828.418593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127391872 00000100:00100000:0.0:1788586828.418654:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586828.418663:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a526b1ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:7450:x1875469127391872:12345-0@lo:256: 20000000:01000000:0.0:1788586828.419815:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788586828.419846:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788586828.419850:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788586828.420024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a526b1ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:7450:x1875469127391872:12345-0@lo:256: Request processed in 1361us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.420036:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788586828.420722:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127391872:0@lo:256: 10000000:01000000:2.0:1788586828.421345:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788586828.421362:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.421373:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586828.421382:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5baaa5e000 from 1 10000000:01000000:2.0:1788586828.421385:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586828.421436:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.421443:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.421451:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.421470:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392000:0@lo:101: 00000100:00100000:2.0:1788586828.421801:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.421851:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcda916b going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.422199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392000 00000100:00100000:3.0:1788586828.422207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392000 00000100:00100000:3.0:1788586828.422253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586828.422262:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db74eaf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:7450:x1875469127392000:12345-0@lo:101: 00010000:00010000:3.0:1788586828.422276:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586828.422289:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd94ff expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.422329:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.422351:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.422359:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002feeaa3a, rc 0) 00000100:00100000:3.0:1788586828.422398:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db74eaf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:7450:x1875469127392000:12345-0@lo:101: Request processed in 137us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.422404:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788586828.422619:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392000:0@lo:101: 00010000:00010000:2.0:1788586828.422634:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.423385:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586828.424619:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392128:0@lo:501: 00000100:00100000:2.0:1788586828.424770:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.424813:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcda916b going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.424908:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392128 00000100:00100000:0.0:1788586828.424917:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392128 00000100:00100000:0.0:1788586828.424964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788586828.424973:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c78c216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:7450:x1875469127392128:12345-0@lo:501: 00000100:00100000:0.0:1788586828.425097:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c78c216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:7450:x1875469127392128:12345-0@lo:501: Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.425115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788586828.425210:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392128:0@lo:501: 00000100:00100000:2.0:1788586828.425245:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392256:0@lo:503: 00000100:00100000:2.0:1788586828.425283:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.425305:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcda916b going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.425444:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392256 00000100:00100000:0.0:1788586828.425449:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392256 00000100:00100000:0.0:1788586828.425475:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586828.425481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000819e3d30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:7450:x1875469127392256:12345-0@lo:503: 00000040:00080000:0.0:1788586828.425704:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788586828.425750:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000819e3d30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:7450:x1875469127392256:12345-0@lo:503: Request processed in 268us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.425757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586828.425806:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d0768c pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392256:0@lo:503: 00000040:00080000:0.0:1788586828.426136:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586828.426198:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788586828.426280:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586828.427051:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788586828.427101:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788586828.427126:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586828.427140:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.427152:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586828.427203:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788586828.427207:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5baaa5e000 10000000:01000000:0.0:1788586828.427211:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5baaa5e000 10000000:01000000:0.0:1788586828.427215:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788586828.427222:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5baaa5e000 from 1 10000000:01000000:0.0:1788586828.427225:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586828.427264:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.427272:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.427280:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.427298:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392384:0@lo:101: 00000100:00100000:0.0:1788586828.427351:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.427388:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003004038 going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.430090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392384 00000100:00100000:3.0:1788586828.430105:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392384 00000100:00100000:3.0:1788586828.430169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586828.430180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e920acfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:7450:x1875469127392384:12345-0@lo:101: 00010000:00010000:3.0:1788586828.430196:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586828.430215:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000eac0702/0xfbc93bbea5fd9514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd950d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.430244:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000eac0702/0xfbc93bbea5fd9514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.430255:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000eac0702/0xfbc93bbea5fd9514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.430265:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000eac0702, rc 0) 00000100:00100000:3.0:1788586828.430348:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e920acfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392384:12345-0@lo:101: Request processed in 170us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.430355:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586828.432162:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392384:0@lo:101: 00010000:00010000:0.0:1788586828.432193:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.432204:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.432332:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392512:0@lo:501: 00000100:00100000:0.0:1788586828.432396:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.432470:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db16377a going to sleep for 11 seconds 00000100:00100000:1.0:1788586828.432609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392512 00000100:00100000:1.0:1788586828.432627:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392512 00000100:00100000:1.0:1788586828.432669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788586828.432676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001265a3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392512:12345-0@lo:501: 00000100:00100000:1.0:1788586828.432804:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001265a3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392512:12345-0@lo:501: Request processed in 128us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586828.432812:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586828.432926:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392512:0@lo:501: 00000100:00100000:0.0:1788586828.432952:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392640:0@lo:503: 00000100:00100000:0.0:1788586828.432993:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.433015:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db16377a going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.433077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392640 00000100:00100000:3.0:1788586828.433082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392640 00000100:00100000:3.0:1788586828.433113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586828.433126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007afd5868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392640:12345-0@lo:503: 00000100:00100000:3.0:1788586828.433202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007afd5868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392640:12345-0@lo:503: Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.433209:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788586828.433278:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392640:0@lo:503: 00000040:00080000:0.0:1788586828.433842:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788586828.433925:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392768:0@lo:502: 00000100:00100000:0.0:1788586828.433973:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.434047:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db16377a going to sleep for 11 seconds 00000100:00080000:2.0:1788586828.434277:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000ef648a8f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586828.434341:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041100217 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875469127391488:12345-0@lo:38: Request processed in 17686us (18031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.434356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586828.434485:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788586828.434494:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788586828.434512:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788586828.434518:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788586828.434520:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000b5426203 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788586828.434529:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c61b305f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127391488:0@lo:38: 00000100:00100000:0.0:1788586828.434782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004640c38c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127392896:0@lo:41: 00000100:00100000:0.0:1788586828.434817:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.434900:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392896 00000100:00100000:2.0:1788586828.434905:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392896 00000100:00100000:2.0:1788586828.434944:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586828.434952:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b82a0bc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875469127392896:12345-0@lo:41: 00000004:00000024:2.0:1788586828.434977:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788586828.435015:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b82a0bc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875469127392896:12345-0@lo:41: Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586828.435021:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586828.435086:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004640c38c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127392896:0@lo:41: 00000100:00100000:3.0:1788586828.435181:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127392768 00000100:00100000:3.0:1788586828.435187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127392768 00000100:00100000:3.0:1788586828.435216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788586828.435223:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042891ff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392768:12345-0@lo:502: 00000100:00100000:3.0:1788586828.435324:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042891ff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127392768:12345-0@lo:502: Request processed in 102us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.435344:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127392768:0@lo:502: 00000040:00080000:0.0:1788586828.435754:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788586828.435788:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788586828.435803:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788586828.435817:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788586828.435830:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788586828.435843:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788586828.435856:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788586828.435868:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788586828.435882:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788586828.435896:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788586828.435910:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788586828.435923:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788586828.435936:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788586828.435951:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788586828.435965:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000100:00100000:3.0:1788586828.435988:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:0.0:1788586828.435993:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788586828.436005:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788586828.436018:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788586828.436030:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788586828.436044:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788586828.436058:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788586828.436072:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788586828.436084:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788586828.436098:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788586828.436111:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788586828.436126:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788586828.436140:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788586828.436153:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788586828.436182:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127393024:0@lo:502: 00000100:00100000:0.0:1788586828.436349:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.436388:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db16377a going to sleep for 11 seconds 00000100:00100000:1.0:1788586828.436655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393024 00000100:00100000:1.0:1788586828.436661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393024 00000100:00100000:1.0:1788586828.436796:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788586828.436804:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e726ae8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127393024:12345-0@lo:502: 00000100:00100000:1.0:1788586828.436956:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e726ae8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127393024:12345-0@lo:502: Request processed in 153us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586828.436964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788586828.437187:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005220c490 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127393024:0@lo:502: 00000040:00080000:2.0:1788586828.437285:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788586828.437304:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788586828.438084:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788586828.438106:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000960e56fa) 00000020:00000080:1.0:1788586828.438128:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788586828.438228:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002e240f84 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788586828.438233:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002e240f84 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788586828.438235:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002e240f84 3 00010000:00080000:1.0:1788586828.438275:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a0b53628@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788586828.441354:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788586828.442118:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788586828.442163:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586828.442188:0:7468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xfbc93bbea5fd9522 00000100:00080000:1.0:1788586828.442199:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586828.442205:0:7468:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000a0b53628 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586828.442238:0:7468:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024b019b7 x1875469127393152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586828.442276:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788586828.442697:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024b019b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127393152:0@lo:38: 00000100:00100000:2.0:1788586828.442780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586828.442856:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393152 00000100:00100000:1.0:1788586828.442864:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393152 00000100:00100000:1.0:1788586828.442910:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586828.442917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064308a01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127393152:12345-0@lo:38: 00010000:00080000:1.0:1788586828.442942:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788586828.442970:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfbc93bbea5fd9529 00000004:00100000:1.0:1788586828.442985:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788586828.443016:0:6520:0:(import.c:65:import_set_state_nolock()) 000000008030d92a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586828.443083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064308a01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875469127393152:12345-0@lo:38: Request processed in 165us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586828.443090:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788586828.443887:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000024b019b7 x1875469127393152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586828.443904:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586828.443911:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788586828.443918:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788586828.443928:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788586828.443930:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000a0b53628 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788586828.443937:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024b019b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127393152:0@lo:38: 00000040:00080000:3.0:1788586828.444698:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788586828.445006:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1788586828.445875:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788586828.445915:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788586828.445969:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586828.445983:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000c141b097/0xfbc93bbea5fd950d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788586828.446044:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788586828.446047:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788586828.446048:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586828.446049:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586828.446050:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586828.446051:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586828.446052:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586828.446054:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586828.446055:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586828.446057:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586828.446058:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788586828.446062:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788586828.446064:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788586828.446071:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788586828.446072:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586828.446073:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586828.446074:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586828.446075:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586828.446075:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586828.446076:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586828.446077:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586828.446078:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586828.446079:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788586828.446102:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788586828.446119:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c58049c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127393280:0@lo:253: 00000100:00100000:2.0:1788586828.446189:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586828.446232:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000002bd3e39c going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.449922:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393280 00000100:00100000:3.0:1788586828.449936:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393280 00000100:00100000:3.0:1788586828.450042:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788586828.450052:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051acee73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127393280:12345-0@lo:253: 20000000:01000000:3.0:1788586828.450084:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788586828.450100:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788586828.454303:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788586828.454375:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788586828.454389:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788586828.454520:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788586828.454525:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788586828.454546:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.454565:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.454581:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.454609:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.454648:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.454661:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 15 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.454675:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127393408:0@lo:104: 00000100:00100000:3.0:1788586828.454749:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586828.454810:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586828.454817:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 15 pid: 6516 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.454825:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025bdff9f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127393536:0@lo:104: 00000100:00100000:3.0:1788586828.454847:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586828.454869:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1eaaba0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.455166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393408 00000100:00100000:0.0:1788586828.455174:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393408 00000100:00100000:0.0:1788586828.455224:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393536 00000100:00100000:0.0:1788586828.455227:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393536 00000100:00100000:0.0:1788586828.455240:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586828.455247:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a385954 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6536:x1875469127393408:12345-0@lo:104: 00010000:00010000:0.0:1788586828.455259:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455314:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586828.455319:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a385954 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6536:x1875469127393408:12345-0@lo:104: Request processed in 72us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.455326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586828.455347:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586828.455352:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7ae6cbc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127393536:12345-0@lo:104: 00010000:00010000:0.0:1788586828.455359:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455389:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586828.455393:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7ae6cbc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127393536:12345-0@lo:104: Request processed in 42us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.455399:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788586828.455436:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788586828.455441:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455448:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009fe80152 already unused, calling callback (00000000a1a57611) 10000000:00010000:0.0:1788586828.455451:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455458:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586828.455464:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586828.455470:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788586828.455498:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455505:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586828.455521:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455536:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 000000009fe80152/0xfbc93bbea5fd94ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd94f8 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455548:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586828.455550:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455556:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066e2f14b already unused, calling callback (00000000a1a57611) 10000000:00010000:0.0:1788586828.455558:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.455563:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586828.455576:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586828.455966:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051acee73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7450:x1875469127393280:12345-0@lo:253: Request processed in 5916us (9777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.455975:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788586828.455994:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c58049c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:7450:1875469127393280:0@lo:253: 10000000:01000000:2.0:1788586828.456005:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788586828.456008:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788586828.456010:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788586828.456011:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586828.456012:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586828.456013:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 10000000:01000000:0.0:1788586828.456014:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:01000004:2.0:1788586828.456015:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586828.456016:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788586828.456017:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586828.456018:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586828.456019:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586828.456021:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1788586828.456027:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788586828.456032:0:7450:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788586828.456033:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586828.456046:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456051:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 0000000066e2f14b/0xfbc93bbea5fd9449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9450 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586828.456072:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586828.456073:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586828.456080:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586828.456092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c80d32c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127393664:0@lo:103: 00000100:00100000:0.0:1788586828.456122:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.456155:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001649d220 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127393792:0@lo:103: 00000100:00100000:0.0:1788586828.456180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.456216:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393664 00000100:00100000:0.0:1788586828.456221:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393664 00010000:00010000:0.0:1788586828.456236:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 15 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.456256:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393792 00000100:00100000:0.0:1788586828.456259:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393792 00010000:00010000:0.0:1788586828.456268:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 16 pid: 6516 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.456280:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586828.456286:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000023b5b3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3647:x1875469127393664:12345-0@lo:103: 00010000:00010000:0.0:1788586828.456296:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586828.456300:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 16 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456309:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 16 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456324:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586828.456349:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000023b5b3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3647:x1875469127393664:12345-0@lo:103: Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.456356:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586828.456373:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586828.456379:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af03d237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3648:x1875469127393792:12345-0@lo:103: 00010000:00010000:0.0:1788586828.456386:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586828.456390:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 15 pid: 6516 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456397:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 15 pid: 6516 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456408:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456433:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586828.456448:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001924231s 00010000:00010000:0.0:1788586828.456452:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456458:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456464:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456470:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456475:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000250ff195 already unused, calling callback (0000000085c85942) 00010000:00010000:0.0:1788586828.456478:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456495:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456503:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456513:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586828.456540:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af03d237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3648:x1875469127393792:12345-0@lo:103: Request processed in 161us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.456545:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586828.456644:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001649d220 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127393792:0@lo:103: 00000100:00100000:0.0:1788586828.456669:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c80d32c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127393664:0@lo:103: 00010000:00010000:0.0:1788586828.456726:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b467a40/0xfbc93bbea5fd94f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ea expref: 14 pid: 6514 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.456735:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bfd3d9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127393408:0@lo:104: 00010000:00010000:0.0:1788586828.456761:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f5d9548/0xfbc93bbea5fd9450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9449 expref: 13 pid: 6516 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586828.456778:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025bdff9f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127393536:0@lo:104: 00010000:00010000:0.0:1788586828.456790:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456797:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456801:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586828.456812:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000250ff195/0xfbc93bbea5fd9530 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788586828.472833:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788586828.473069:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788586828.474832:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788586828.475068:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788586828.476017:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788586828.476616:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788586828.483965:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788586828.485608:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788586828.486248:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788586828.486621:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788586828.486808:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788586828.486985:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788586828.489063:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788586828.489484:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788586828.489538:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c80d32c4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1875469127393920:0@lo:700: 00000100:00100000:0.0:1788586828.489621:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.489673:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054e07a34 going to sleep for 11 seconds 00000100:00100000:2.0:1788586828.489743:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127393920 00000100:00100000:2.0:1788586828.489751:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127393920 00000100:00100000:2.0:1788586828.489815:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586828.489824:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001649d220 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1875469127393920:12345-0@lo:700: 00000040:01000000:2.0:1788586828.489965:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:3.0:1788586828.491062:0:7473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788586828.491068:0:7473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788586828.491290:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394048:0@lo:1000: 00000100:00100000:1.0:1788586828.491372:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586828.491557:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9ad01c5 going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.491630:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127394048 00000100:00100000:3.0:1788586828.491636:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127394048 00000100:00100000:3.0:1788586828.491694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586828.491702:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a079bc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394048:12345-0@lo:1000: 00000100:00100000:3.0:1788586828.492027:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a079bc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394048:12345-0@lo:1000: Request processed in 326us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.492035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586828.492234:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394048:0@lo:1000: 00000040:01000000:1.0:1788586828.492266:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788586828.492294:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394176:0@lo:700: 00000100:00100000:1.0:1788586828.492324:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586828.492361:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065071357 going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.492538:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127394176 00000100:00100000:3.0:1788586828.492544:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127394176 00000100:00100000:3.0:1788586828.492587:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586828.492595:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000961efe8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394176:12345-0@lo:700: 00000100:00100000:3.0:1788586828.492641:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000961efe8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394176:12345-0@lo:700: Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.492648:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586828.492989:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394176:0@lo:700: 00000100:00100000:1.0:1788586828.493040:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875469127394304:0@lo:900: 00000100:00100000:1.0:1788586828.493153:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586828.493194:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065071357 going to sleep for 11 seconds 00000100:00100000:3.0:1788586828.493704:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127394304 00000100:00100000:3.0:1788586828.493711:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127394304 00000100:00100000:3.0:1788586828.493797:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586828.493805:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d041e63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1875469127394304:12345-0@lo:900: 00000100:00100000:3.0:1788586828.493857:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d041e63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1875469127394304:12345-0@lo:900: Request processed in 54us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586828.493863:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788586828.494272:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dd39d0e0 x1875469127394304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788586844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586828.494285:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875469127394304:0@lo:900: 00000100:00100000:1.0:1788586828.494407:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394432:0@lo:1000: 00000100:00100000:1.0:1788586828.494466:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586828.494488:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e3e0e8b going to sleep for 11 seconds 00000040:01000000:2.0:1788586828.496025:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788586828.496368:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788586828.497438:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127394432 00000100:00100000:0.0:1788586828.497466:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127394432 00000100:00100000:0.0:1788586828.497548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586828.497558:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a16c7f03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394432:12345-0@lo:1000: 00000100:00100000:0.0:1788586828.497684:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a16c7f03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394432:12345-0@lo:1000: Request processed in 128us (3218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586828.497691:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00000080:2.0:1788586828.498735:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:1.0:1788586828.499029:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394432:0@lo:1000: 00000004:00080000:1.0:1788586828.499389:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000065071357 with version 0 00000020:00100000:1.0:1788586828.499590:0:7475:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788586828.499598:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000dd39d0e0 x1875469127394688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788586828.499634:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394688:0@lo:1000: 00000100:00100000:1.0:1788586828.499718:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586828.499814:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127394688 00000100:00100000:0.0:1788586828.499822:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127394688 00000100:00100000:0.0:1788586828.499876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586828.499885:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064b024ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394688:12345-0@lo:1000: 00000100:00100000:1.0:1788586828.500497:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e20a029e going to sleep for 11 seconds 00000040:01000000:2.0:1788586828.501525:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788586828.502019:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:3.0:1788586828.503162:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:2.0:1788586828.504556:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788586828.506603:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788586828.506687:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000001:00080000:1.0:1788586828.507667:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000040:00080000:2.0:1788586828.508091:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788586828.508357:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788586828.509057:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788586828.509203:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788586828.509342:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788586828.509528:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788586828.510369:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788586828.510680:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788586828.511190:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788586828.511404:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788586828.511638:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788586828.512003:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788586828.512265:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788586828.512411:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788586828.512602:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788586828.512948:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788586828.513306:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788586828.513530:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788586828.514217:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788586828.514369:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:1.0:1788586828.516450:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001649d220 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1875469127393920:12345-0@lo:700: Request processed in 26620us (26821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586828.516486:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788586828.516673:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c80d32c4 x1875469127393920/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788586844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586828.517196:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c80d32c4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1875469127393920:0@lo:700: 40000000:02000000:3.0:1788586828.517212:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1788586828.518206:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788586828.519299:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:0.0:1788586828.520507:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064b024ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394688:12345-0@lo:1000: Request processed in 20617us (20797us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788586828.520535:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788586828.520657:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788586828.520662:0:7475:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788586828.520677:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394688:0@lo:1000: 00000100:00100000:1.0:1788586828.520761:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394816:0@lo:1000: 00100000:10000000:2.0:1788586828.521299:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:1.0:1788586828.521855:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586828.522137:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127394816 00000100:00100000:1.0:1788586828.522145:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127394816 00000100:00100000:1.0:1788586828.522196:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586828.522205:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb8905de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394816:12345-0@lo:1000: 00000100:00100000:1.0:1788586828.522273:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb8905de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875469127394816:12345-0@lo:1000: Request processed in 70us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586828.522279:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586828.522314:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000720bf993 going to sleep for 11 seconds 00000100:00100000:1.0:1788586828.522979:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875469127394816:0@lo:1000: 00000040:00080000:1.0:1788586828.523008:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788586828.523044:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000065071357 with version 1 00100000:10000000:2.0:1788586828.523590:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000004:00080000:0.0:1788586828.523996:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003b45c647 version 1 rpc_version 1 00000020:00100000:0.0:1788586828.524034:0:7465:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788586828.524044:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000f2d1a90 x1875469127395072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788586828.524945:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875469127395072:0@lo:1000: 00000100:00100000:0.0:1788586828.525012:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1788586828.525305:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788586828.525585:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788586828.525725:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000100:00100000:0.0:1788586828.526873:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1314515 going to sleep for 11 seconds 00000100:00100000:0.0:1788586828.526963:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395072 00000100:00100000:0.0:1788586828.526972:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395072 00000100:00100000:0.0:1788586828.527026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586828.527034:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000023b5b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875469127395072:12345-0@lo:1000: 00100000:10000000:2.0:1788586828.530224:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788586828.531606:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:1.0:1788586828.535509:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788586828.535604:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1788586828.536286:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788586828.538351:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000001:00080000:0.0:1788586828.538411:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00100000:10000000:2.0:1788586828.538552:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000100:00100000:0.0:1788586828.538554:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000023b5b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1875469127395072:12345-0@lo:1000: Request processed in 11518us (13539us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788586828.538566:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788586828.538627:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788586828.538632:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788586828.538648:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875469127395072:0@lo:1000: 00100000:10000000:2.0:1788586828.538731:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788586828.540185:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788586828.543841:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788586828.553167:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788586828.553665:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788586828.553704:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffacde45597988 00100000:10000000:2.0:1788586828.553714:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788586828.555677:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788586828.555714:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788586828.555739:0:7450:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788586828.555767:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788586828.557146:0:7450:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788586828.557641:0:7450:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788586828.569160:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788586828.569255:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788586828.569261:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788586829.268806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586830.311830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586831.316880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586832.340540:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586833.169117:0:7719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788586833.370987:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586833.752833:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a21e29f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127395200:0@lo:400: 00000100:00100000:2.0:1788586833.752925:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586833.753874:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788586833.753885:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000705bbc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127395584:0@lo:400: 00000100:00100000:2.0:1788586833.753933:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586833.753950:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395200 00000100:00100000:0.0:1788586833.753959:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395200 00000100:00100000:0.0:1788586833.754021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788586833.754035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e304652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3649:x1875469127395200:12345-0@lo:400: 00000100:00100000:0.0:1788586833.754089:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e304652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3649:x1875469127395200:12345-0@lo:400: Request processed in 56us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586833.754096:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788586833.754959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395584 00000100:00100000:2.0:1788586833.754982:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395584 00000100:00100000:2.0:1788586833.755026:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586833.755033:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c58049c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127395584:12345-0@lo:400: 00000100:00100000:2.0:1788586833.755087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c58049c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127395584:12345-0@lo:400: Request processed in 56us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586833.755095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586833.755117:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009be298e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127395712:0@lo:41: 00000100:00100000:2.0:1788586833.755164:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788586833.755199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000705bbc9 x1875469127395584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586833.755214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000705bbc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127395584:0@lo:400: 00000100:00100000:2.0:1788586833.755226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a21e29f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127395200:0@lo:400: 00000100:00100000:2.0:1788586833.755668:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057bbd073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127395328:0@lo:400: 00000100:00100000:2.0:1788586833.755701:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586833.755730:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586833.755736:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047f91d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127395456:0@lo:400: 00000100:00100000:2.0:1788586833.755756:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586833.755793:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395712 00000100:00100000:2.0:1788586833.755797:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395712 00000100:00100000:2.0:1788586833.755817:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395456 00000100:00100000:2.0:1788586833.755820:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395456 00000100:00100000:2.0:1788586833.755832:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586833.755838:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d05aa0e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875469127395712:12345-0@lo:41: 00000004:00000024:2.0:1788586833.755868:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788586833.755895:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d05aa0e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875469127395712:12345-0@lo:41: Request processed in 58us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586833.755909:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586833.755920:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586833.755924:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1ef0a61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127395456:12345-0@lo:400: 00000100:00100000:2.0:1788586833.755950:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1ef0a61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127395456:12345-0@lo:400: Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586833.755956:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788586833.755960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395328 00000100:00100000:1.0:1788586833.755966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395328 00000100:00100000:2.0:1788586833.755992:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047f91d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127395456:0@lo:400: 00000100:00100000:1.0:1788586833.756001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586833.756010:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069a7c7fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127395328:12345-0@lo:400: 00000100:00100000:2.0:1788586833.756021:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009be298e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127395712:0@lo:41: 00000100:00100000:1.0:1788586833.756277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069a7c7fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127395328:12345-0@lo:400: Request processed in 269us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586833.756284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788586833.756515:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000057bbd073 x1875469127395328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586833.756526:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057bbd073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127395328:0@lo:400: 00000020:00000004:0.0:1788586834.061891:0:7771:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586834.062091:0:7771:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788586834.390977:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586835.412602:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586836.436555:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788586836.738918:0:7873:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788586836.739110:0:7873:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788586837.332481:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788586837.332489:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5baaa5e000 from 4 10000000:01000000:0.0:1788586837.332495:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788586837.332548:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.332561:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.332572:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.332595:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127395840:0@lo:101: 00000100:00100000:0.0:1788586837.332685:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.332730:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019cc18a4 going to sleep for 11 seconds 00000100:00100000:3.0:1788586837.332903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395840 00000100:00100000:3.0:1788586837.332911:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395840 00000100:00100000:3.0:1788586837.332968:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788586837.332977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000010a33e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127395840:12345-0@lo:101: 00010000:00010000:3.0:1788586837.332991:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586837.333005:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d4c1b57/0xfbc93bbea5fd953e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9537 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.333547:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d4c1b57/0xfbc93bbea5fd953e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.333560:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d4c1b57/0xfbc93bbea5fd953e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.333568:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d4c1b57, rc 0) 00000100:00100000:3.0:1788586837.333631:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000010a33e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127395840:12345-0@lo:101: Request processed in 655us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586837.333638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788586837.333846:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127395840:0@lo:101: 00010000:00010000:0.0:1788586837.333861:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.333869:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.333921:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127395968:0@lo:256: 00000100:00100000:0.0:1788586837.333963:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.333994:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019cc18a4 going to sleep for 11 seconds 00000100:00100000:1.0:1788586837.334047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127395968 00000100:00100000:1.0:1788586837.334052:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127395968 00000100:00100000:1.0:1788586837.334089:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788586837.334096:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e62f2be5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127395968:12345-0@lo:256: 20000000:01000000:1.0:1788586837.334118:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788586837.334134:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788586837.334137:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788586837.334230:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e62f2be5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127395968:12345-0@lo:256: Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586837.334238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788586837.334526:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f2d1a90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127395968:0@lo:256: 10000000:01000000:3.0:1788586837.334570:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788586837.334576:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.334594:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000001fe494ef/0xfbc93bbea5fd9537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586837.334605:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586837.334607:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5b86e73000 from 21 10000000:01000000:3.0:1788586837.334610:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586837.334638:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.334646:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.334660:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586837.334673:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000106762fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396096:0@lo:101: 00000100:00100000:3.0:1788586837.334700:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586837.334726:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e22f1da8 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.334825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396096 00000100:00100000:0.0:1788586837.334830:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396096 00000100:00100000:0.0:1788586837.334853:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586837.334859:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f82940a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127396096:12345-0@lo:101: 00010000:00010000:0.0:1788586837.334867:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586837.334876:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ec1ed2f/0xfbc93bbea5fd954c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9545 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.334891:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ec1ed2f/0xfbc93bbea5fd954c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.334899:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ec1ed2f/0xfbc93bbea5fd954c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.334906:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ec1ed2f, rc 0) 00000100:00100000:0.0:1788586837.334939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f82940a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127396096:12345-0@lo:101: Request processed in 80us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.334944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788586837.339303:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000106762fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396096:0@lo:101: 00010000:00010000:3.0:1788586837.339332:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.339346:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586837.339468:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000106762fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396224:0@lo:501: 00000100:00100000:3.0:1788586837.339543:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586837.339600:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e22f1da8 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.339769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396224 00000100:00100000:0.0:1788586837.339777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396224 00000100:00100000:0.0:1788586837.339826:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586837.339835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078e925ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127396224:12345-0@lo:501: 00000100:00100000:0.0:1788586837.339991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078e925ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127396224:12345-0@lo:501: Request processed in 157us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.339999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788586837.340298:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000106762fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396224:0@lo:501: 00000100:00100000:1.0:1788586837.340331:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396352:0@lo:503: 00000100:00100000:1.0:1788586837.340374:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586837.340410:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096ca2e86 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.340525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396352 00000100:00100000:0.0:1788586837.340536:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396352 00000100:00100000:0.0:1788586837.340568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788586837.340574:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8488dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127396352:12345-0@lo:503: 00000100:00100000:0.0:1788586837.340666:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8488dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127396352:12345-0@lo:503: Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.340673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788586837.340712:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396352:0@lo:503: 00000100:00100000:0.0:1788586837.340933:0:7893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7893:1875469127396480:0@lo:502: 00000100:00100000:0.0:1788586837.340967:0:7893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.340985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396480 00000100:00100000:0.0:1788586837.340988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396480 00000100:00100000:0.0:1788586837.341005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788586837.341010:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbcdd04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7893:x1875469127396480:12345-0@lo:502: 00000100:00100000:0.0:1788586837.341088:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbcdd04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7893:x1875469127396480:12345-0@lo:502: Request processed in 77us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.341095:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788586837.341127:0:7893:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5043191 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.341138:0:7893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7893:1875469127396480:0@lo:502: 00000100:00100000:0.0:1788586837.341187:0:7893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7893:1875469127396608:0@lo:502: 00000100:00100000:0.0:1788586837.341216:0:7893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.341234:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396608 00000100:00100000:0.0:1788586837.341237:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396608 00000100:00100000:0.0:1788586837.341253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788586837.341257:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345f2bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7893:x1875469127396608:12345-0@lo:502: 00000100:00100000:0.0:1788586837.341320:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345f2bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:7893:x1875469127396608:12345-0@lo:502: Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.341335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788586837.341357:0:7893:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5043191 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.341367:0:7893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7893:1875469127396608:0@lo:502: 00000040:00080000:0.0:1788586837.341383:0:7893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788586837.341456:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788586837.341483:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586837.341491:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341502:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 0000000065f4ff4c/0xfbc93bbea5fd9545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586837.341521:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788586837.341524:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5b86e73000 from 4 10000000:01000000:0.0:1788586837.341527:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788586837.341550:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341557:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341566:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.341577:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396736:0@lo:101: 00000100:00100000:0.0:1788586837.341601:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.341622:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5043191 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.341632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396736 00000100:00100000:0.0:1788586837.341635:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396736 00000100:00100000:0.0:1788586837.341659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788586837.341664:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012a56187 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127396736:12345-0@lo:101: 00010000:00010000:0.0:1788586837.341672:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586837.341682:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4270fa1/0xfbc93bbea5fd955a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9553 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341700:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4270fa1/0xfbc93bbea5fd955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341708:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4270fa1/0xfbc93bbea5fd955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341715:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4270fa1, rc 0) 00000100:00100000:0.0:1788586837.341747:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012a56187 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127396736:12345-0@lo:101: Request processed in 83us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.341753:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788586837.341778:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396736:0@lo:101: 00010000:00010000:0.0:1788586837.341788:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.341795:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.341830:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396864:0@lo:256: 00000100:00100000:0.0:1788586837.341858:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.341871:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5043191 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.341882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396864 00000100:00100000:0.0:1788586837.341885:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396864 00000100:00100000:0.0:1788586837.341900:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788586837.341911:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001968576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127396864:12345-0@lo:256: 20000000:01000000:0.0:1788586837.341923:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788586837.341940:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788586837.341943:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788586837.342011:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001968576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127396864:12345-0@lo:256: Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.342018:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788586837.342045:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396864:0@lo:256: 10000000:01000000:0.0:1788586837.342086:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788586837.342091:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342098:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000006fd44d78/0xfbc93bbea5fd9553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586837.342104:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788586837.342106:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788586837.342108:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788586837.342121:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342126:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342132:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.342141:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396992:0@lo:101: 00000100:00100000:0.0:1788586837.342164:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.342184:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000462563cb going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.342195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127396992 00000100:00100000:0.0:1788586837.342198:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127396992 00000100:00100000:0.0:1788586837.342213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788586837.342218:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000089441b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127396992:12345-0@lo:101: 00010000:00010000:0.0:1788586837.342224:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586837.342231:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000fc1bdc4/0xfbc93bbea5fd9568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9561 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342243:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000fc1bdc4/0xfbc93bbea5fd9568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342251:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000fc1bdc4/0xfbc93bbea5fd9568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342257:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000fc1bdc4, rc 0) 00000100:00100000:0.0:1788586837.342281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000089441b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127396992:12345-0@lo:101: Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.342287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788586837.342310:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127396992:0@lo:101: 00010000:00010000:0.0:1788586837.342319:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.342325:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.342365:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127397120:0@lo:501: 00000100:00100000:0.0:1788586837.342387:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.342397:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000462563cb going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.342437:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397120 00000100:00100000:0.0:1788586837.342441:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397120 00000100:00100000:0.0:1788586837.342458:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788586837.342463:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f818a688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127397120:12345-0@lo:501: 00000100:00100000:0.0:1788586837.342568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f818a688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127397120:12345-0@lo:501: Request processed in 104us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.342575:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788586837.342599:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127397120:0@lo:501: 00000100:00100000:0.0:1788586837.342619:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127397248:0@lo:503: 00000100:00100000:0.0:1788586837.342654:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.342671:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000462563cb going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.342681:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397248 00000100:00100000:0.0:1788586837.342684:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397248 00000100:00100000:0.0:1788586837.342701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788586837.342706:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfee2d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127397248:12345-0@lo:503: 00000100:00100000:0.0:1788586837.342775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfee2d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127397248:12345-0@lo:503: Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.342782:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788586837.342814:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127397248:0@lo:503: 00000100:00100000:0.0:1788586837.343042:0:7894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7894:1875469127397376:0@lo:502: 00000100:00100000:0.0:1788586837.343077:0:7894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.343094:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397376 00000100:00100000:0.0:1788586837.343097:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397376 00000100:00100000:0.0:1788586837.343113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788586837.343118:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b026d4a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:7894:x1875469127397376:12345-0@lo:502: 00000100:00100000:0.0:1788586837.343177:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b026d4a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:7894:x1875469127397376:12345-0@lo:502: Request processed in 59us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.343188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788586837.343212:0:7894:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5043191 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.343223:0:7894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7894:1875469127397376:0@lo:502: 00000020:01000000:0.0:1788586837.343240:0:7894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586837.343250:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586837.343253:0:7894:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788586837.343257:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788586837.343261:0:7894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:00000080:0.0:1788586837.343287:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788586837.343303:0:7894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000018d062ef) 00000020:00000080:0.0:1788586837.343320:0:7894:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788586837.343326:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788586837.343404:0:7894:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788586837.343410:0:7894:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788586837.343442:0:7894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd9576 00010000:00080000:0.0:1788586837.343470:0:7894:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000075c84de7@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788586837.361349:0:7894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788586837.363678:0:7894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788586837.363696:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788586837.363737:0:7894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788586837.363760:0:7894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd957d 00000100:00080000:1.0:1788586837.363771:0:7894:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586837.363777:0:7894:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000075c84de7 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586837.363810:0:7894:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce7ec2e0 x1875469127397504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586837.363833:0:7894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788586837.363870:0:7894:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788586837.364102:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce7ec2e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127397504:0@lo:38: 00000100:00100000:2.0:1788586837.364192:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586837.364505:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397504 00000100:00100000:1.0:1788586837.364523:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397504 00000100:00100000:1.0:1788586837.364558:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788586837.364565:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009be298e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875469127397504:12345-0@lo:38: 00010000:00080000:1.0:1788586837.364589:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1788586837.364786:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd9584 00000004:00100000:1.0:1788586837.364801:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788586837.364813:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788586837.365091:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127397632:0@lo:400: 00000100:00100000:0.0:1788586837.365136:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.365173:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586837.365179:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127397760:0@lo:400: 00000100:00100000:0.0:1788586837.365201:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.365222:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcc19ec0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127397888:0@lo:400: 00000100:00100000:0.0:1788586837.365243:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.365283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397632 00000100:00100000:0.0:1788586837.365287:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397632 00000100:00100000:0.0:1788586837.365318:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397888 00000100:00100000:0.0:1788586837.365321:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397888 00000100:00100000:0.0:1788586837.365343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586837.365349:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a52c52ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127397632:12345-0@lo:400: 00000100:00100000:0.0:1788586837.365391:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a52c52ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127397632:12345-0@lo:400: Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.365398:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586837.365441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586837.365447:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80d32c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127397888:12345-0@lo:400: 00000100:00100000:0.0:1788586837.365475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80d32c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127397888:12345-0@lo:400: Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.365481:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788586837.365529:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004e05f7eb x1875469127397632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586837.365544:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127397632:0@lo:400: 00010000:00080000:0.0:1788586837.365566:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dcc19ec0 x1875469127397888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586837.365574:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcc19ec0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127397888:0@lo:400: 00000100:00100000:2.0:1788586837.366015:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788586837.366024:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788586837.366136:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127397760 00000100:00100000:2.0:1788586837.366143:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127397760 00000100:00100000:2.0:1788586837.366255:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586837.366262:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f2d1a90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127397760:12345-0@lo:400: 00000100:00100000:2.0:1788586837.366316:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f2d1a90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127397760:12345-0@lo:400: Request processed in 55us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586837.366322:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788586837.366539:0:7897:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000ea539341 x1875469127398016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586837.366549:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070aa50d7 going to sleep for 0 seconds 00000100:00100000:0.0:1788586837.366782:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127397760:0@lo:400: 00000020:01000000:1.0:1788586837.366859:0:7894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586837.366866:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586837.366868:0:7894:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788586837.366872:0:7894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586837.366877:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586837.366878:0:7894:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788586837.366881:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788586837.366883:0:7894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788586837.366904:0:7894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7894:1875469127398144:0@lo:502: 00000100:00100000:1.0:1788586837.367607:0:7894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586837.368052:0:7894:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c415245 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.369037:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398144 00000100:00100000:0.0:1788586837.369048:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398144 00000100:00100000:0.0:1788586837.369110:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788586837.369120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c69bd82d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:7894:x1875469127398144:12345-0@lo:502: 00000100:00100000:1.0:1788586837.369549:0:7894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:7894:1875469127398144:0@lo:502: 00000020:01000000:1.0:1788586837.369584:0:7894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586837.369590:0:7894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586837.369593:0:7894:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788586837.369598:0:7894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788586837.369740:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c69bd82d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:7894:x1875469127398144:12345-0@lo:502: Request processed in 150us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.369749:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000020:01000000:0.0:1788586837.371030:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788586837.371080:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788586837.371089:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371101:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 00000000f97e355a/0xfbc93bbea5fd9561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586837.371112:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788586837.371115:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f5bb05e3380 from 1 10000000:01000000:0.0:1788586837.371117:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788586837.371149:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371168:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371177:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.371200:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127398272:0@lo:101: 00000100:00100000:0.0:1788586837.371256:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.371484:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035b6a99f going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.371506:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398272 00000100:00100000:0.0:1788586837.371522:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398272 00000100:00100000:0.0:1788586837.371560:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788586837.371567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028f85244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127398272:12345-0@lo:101: 00010000:00010000:0.0:1788586837.371579:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586837.371589:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000085cbb5d/0xfbc93bbea5fd9592 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd958b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371633:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000085cbb5d/0xfbc93bbea5fd9592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371644:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000085cbb5d/0xfbc93bbea5fd9592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371659:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000085cbb5d, rc 0) 00000100:00100000:0.0:1788586837.371694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028f85244 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127398272:12345-0@lo:101: Request processed in 127us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.371700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788586837.371740:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127398272:0@lo:101: 00010000:00010000:0.0:1788586837.371754:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.371762:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.371823:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127398400:0@lo:501: 00000100:00100000:0.0:1788586837.371847:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.371858:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069f32a30 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.371870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398400 00000100:00100000:0.0:1788586837.371873:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398400 00000100:00100000:0.0:1788586837.371891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788586837.371897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be58376a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127398400:12345-0@lo:501: 00000100:00100000:0.0:1788586837.371978:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be58376a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127398400:12345-0@lo:501: Request processed in 81us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586837.371985:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788586837.372022:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127398400:0@lo:501: 10000000:01000000:0.0:1788586837.372042:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788586837.372045:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.372052:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: 000000000e16cef5/0xfbc93bbea5fd958b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788586837.380690:0:6526:0:(import.c:65:import_set_state_nolock()) 0000000055bfda40 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586837.380827:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009be298e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875469127397504:12345-0@lo:38: Request processed in 16259us (16632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586837.380839:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586837.381527:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586837.381543:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788586837.381553:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788586837.381560:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788586837.381563:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000075c84de7 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788586837.381590:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000070aa50d7): req@00000000ea539341 x1875469127398016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586837.381611:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce7ec2e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127397504:0@lo:38: 00000100:00100000:3.0:1788586837.381764:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127398528:0@lo:41: 00000100:00100000:3.0:1788586837.381840:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586837.381937:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398528 00000100:00100000:2.0:1788586837.381948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398528 00000100:00100000:2.0:1788586837.382008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586837.382017:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d187767 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127398528:12345-0@lo:41: 00000004:00000024:2.0:1788586837.382059:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788586837.382797:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.382832:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070aa50d7 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.384574:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398016 00000100:00100000:0.0:1788586837.384586:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398016 00000100:00100000:0.0:1788586837.384632:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586837.384640:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc19ec0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398016:12345-0@lo:1000: 00000100:00100000:0.0:1788586837.384771:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc19ec0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398016:12345-0@lo:1000: Request processed in 130us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.384778:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586837.384820:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea539341 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398016:0@lo:1000: 00000040:01000000:0.0:1788586837.384859:0:7897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788586837.384897:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398656:0@lo:1000: 00000100:00100000:0.0:1788586837.384943:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.384964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398656 00000100:00100000:0.0:1788586837.384968:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398656 00000100:00100000:0.0:1788586837.384983:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586837.384988:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005220c490 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398656:12345-0@lo:1000: 00000100:00100000:0.0:1788586837.385080:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005220c490 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398656:12345-0@lo:1000: Request processed in 92us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.385104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586837.385129:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046423655 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.385142:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398656:0@lo:1000: 00000100:00100000:0.0:1788586837.385190:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398784:0@lo:700: 00000100:00100000:0.0:1788586837.385213:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.385238:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398784 00000100:00100000:0.0:1788586837.385241:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398784 00000100:00100000:0.0:1788586837.385265:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586837.385283:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfa52208 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398784:12345-0@lo:700: 00000100:00100000:0.0:1788586837.385315:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfa52208 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398784:12345-0@lo:700: Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.385321:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586837.385334:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019cc18a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.385343:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398784:0@lo:700: 00000100:00100000:0.0:1788586837.385767:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398912:0@lo:1000: 00000100:00100000:0.0:1788586837.385800:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.385823:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127398912 00000100:00100000:0.0:1788586837.385826:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127398912 00000100:00100000:0.0:1788586837.385843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586837.385848:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090c4d534 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398912:12345-0@lo:1000: 00000100:00100000:0.0:1788586837.385891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090c4d534 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127398912:12345-0@lo:1000: Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.385897:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586837.385910:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e5801b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586837.385939:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127398912:0@lo:1000: 00000004:00080000:0.0:1788586837.385992:0:7897:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000019cc18a4 with version 0 00000020:00100000:0.0:1788586837.386006:0:7897:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788586837.386012:0:7897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004e05f7eb x1875469127399168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788586837.386024:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127399168:0@lo:1000: 00000100:00100000:0.0:1788586837.386046:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.386063:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127399168 00000100:00100000:0.0:1788586837.386066:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127399168 00000100:00100000:0.0:1788586837.386081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586837.386085:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c01c149 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7897:x1875469127399168:12345-0@lo:1000: 00000100:00100000:0.0:1788586837.386706:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 0000000065071357 going to sleep for 11 seconds 00000100:00100000:2.0:1788586837.387034:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d187767 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3649:x1875469127398528:12345-0@lo:41: Request processed in 5009us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586837.387052:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586837.387823:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f4b6250 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127398528:0@lo:41: 00000001:00080000:2.0:1788586837.396524:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788586837.396547:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788586837.396777:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c01c149 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7897:x1875469127399168:12345-0@lo:1000: Request processed in 10684us (10724us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788586837.396793:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788586837.396956:0:7897:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788586837.396963:0:7897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788586837.396986:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e05f7eb pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127399168:0@lo:1000: 00000100:00100000:1.0:1788586837.397114:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127399296:0@lo:1000: 00000100:00100000:1.0:1788586837.397192:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586837.397223:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set 00000000226f574b going to sleep for 11 seconds 00000100:00100000:2.0:1788586837.400023:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127399296 00000100:00100000:2.0:1788586837.400046:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127399296 00000100:00100000:2.0:1788586837.400137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788586837.400151:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024b019b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7897:x1875469127399296:12345-0@lo:1000: 00000100:00100000:2.0:1788586837.400331:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024b019b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7897:x1875469127399296:12345-0@lo:1000: Request processed in 184us (3139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586837.400339:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586837.403532:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7897:1875469127399296:0@lo:1000: 00000040:00080000:1.0:1788586837.403586:0:7897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788586837.403654:0:7897:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000805e6467 with version 1 00000040:00080000:1.0:1788586837.406864:0:7897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788586837.406986:0:7897:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788586837.406993:0:7897:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1788586837.409392:0:7895:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e1a5a8dc version 1 rpc_version 1 00000020:00100000:3.0:1788586837.409474:0:7895:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788586837.409489:0:7895:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000054e36aaf x1875469127399552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788586837.409527:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000054e36aaf pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7895:1875469127399552:0@lo:1000: 00000100:00100000:3.0:1788586837.409609:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586837.409851:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b6e5394 going to sleep for 11 seconds 00000100:00100000:2.0:1788586837.409940:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127399552 00000100:00100000:2.0:1788586837.409952:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127399552 00000100:00100000:2.0:1788586837.410041:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586837.410050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fce3c155 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7895:x1875469127399552:12345-0@lo:1000: 00000001:00080000:3.0:1788586837.425148:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788586837.425397:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fce3c155 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7895:x1875469127399552:12345-0@lo:1000: Request processed in 15343us (15782us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788586837.425461:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788586837.425751:0:7895:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788586837.425758:0:7895:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788586837.425785:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000054e36aaf pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7895:1875469127399552:0@lo:1000: 00010000:00010000:2.0:1788586837.460669:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788586837.898182:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4f3b8df0 20000000:00000080:1.0:1788586837.898215:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5bbc987c00 uarg=0000000000000000 20000000:01000000:1.0:1788586837.898273:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788586837.898281:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788586837.898287:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788586837.898379:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788586837.898393:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788586837.906498:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586837.908396:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788586837.908472:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788586837.908496:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788586837.908527:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788586837.908547:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.908569:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.908575:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.908580:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.909002:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.909020:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 17 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586837.909035:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875469127399680:0@lo:104: 00000100:00100000:1.0:1788586837.909116:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586837.910004:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.910015:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586837.910026:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c61b305f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875469127399808:0@lo:104: 00000100:00100000:1.0:1788586837.910057:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ac4388e going to sleep for 11 seconds 00000100:00100000:2.0:1788586837.911667:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788586837.911732:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586837.911819:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127399680 00000100:00100000:2.0:1788586837.911833:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127399680 00000100:00100000:2.0:1788586837.911896:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127399808 00000100:00100000:2.0:1788586837.911900:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127399808 00000100:00100000:0.0:1788586837.911917:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586837.911935:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d481a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:7927:x1875469127399680:12345-0@lo:104: 00010000:00010000:0.0:1788586837.911978:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.912086:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586837.912092:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d481a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:7927:x1875469127399680:12345-0@lo:104: Request processed in 165us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.912101:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586837.912165:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586837.912172:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071a8e83f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:7927:x1875469127399808:12345-0@lo:104: 00010000:00010000:0.0:1788586837.912180:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.912235:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586837.912247:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.912258:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d5c99e62 already unused, calling callback (00000000a1a57611) 10000000:00010000:3.0:1788586837.912318:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.912329:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586837.912335:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586837.912359:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788586837.912435:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.912442:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586837.912462:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586837.912469:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 00000000d5c99e62/0xfbc93bbea5fd94ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9506 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586837.912777:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875469127399680:0@lo:104: 00000100:00100000:1.0:1788586837.912790:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c61b305f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875469127399808:0@lo:104: 00010000:00010000:1.0:1788586837.912815:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.916486:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586837.916523:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071a8e83f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:7927:x1875469127399808:12345-0@lo:104: Request processed in 4335us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.916541:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586837.916629:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000054e36aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127399936:0@lo:103: 00000100:00100000:0.0:1788586837.916721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586837.916797:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127399936 00000100:00100000:0.0:1788586837.916806:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127399936 00010000:00010000:0.0:1788586837.916845:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 18 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586837.916880:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586837.916889:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3dad779 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3646:x1875469127399936:12345-0@lo:103: 00010000:00010000:0.0:1788586837.916908:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586837.916913:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 18 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.916926:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 18 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.916959:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002feeaa3a/0xfbc93bbea5fd9506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd94ff expref: 18 pid: 6516 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586837.916978:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586837.917014:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3dad779 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3646:x1875469127399936:12345-0@lo:103: Request processed in 127us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586837.917020:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586837.917063:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000054e36aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127399936:0@lo:103: 00010000:00010000:2.0:1788586837.917560:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586837.917569:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.917580:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec851e47 already unused, calling callback (00000000a1a57611) 10000000:00010000:2.0:1788586837.917584:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.917596:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586837.917603:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586837.917610:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788586837.917705:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.917715:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586837.917767:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.917774:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: 00000000ec851e47/0xfbc93bbea5fd9411 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9418 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.917792:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586837.917794:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586837.917795:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586837.917853:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003228196 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127400064:0@lo:103: 00000100:00100000:1.0:1788586837.917905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586837.918152:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586837.918161:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586837.918165:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586837.921874:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400064 00000100:00100000:2.0:1788586837.921897:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400064 00010000:00010000:2.0:1788586837.921964:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586837.922069:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586837.922080:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c61b305f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3647:x1875469127400064:12345-0@lo:103: 00010000:00010000:2.0:1788586837.922098:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586837.922103:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922117:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922138:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013f8e754/0xfbc93bbea5fd9418 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9411 expref: 17 pid: 6514 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922158:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922167:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922206:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922212:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922218:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922224:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922230:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009c100a07 already unused, calling callback (0000000085c85942) 00010000:00010000:2.0:1788586837.922234:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922242:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922262:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586837.922274:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586837.922369:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c61b305f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3647:x1875469127400064:12345-0@lo:103: Request processed in 291us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586837.922385:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788586837.922473:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586837.922482:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586837.922497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003228196 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127400064:0@lo:103: 00010000:00010000:1.0:1788586837.922501:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009c100a07/0xfbc93bbea5fd9599 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586838.488250:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586838.876059:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000054e36aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127400192:0@lo:41: 00000100:00100000:3.0:1788586838.876159:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586838.876235:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400192 00000100:00100000:3.0:1788586838.876244:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400192 00000100:00100000:3.0:1788586838.876298:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788586838.876307:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073a1711e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127400192:12345-0@lo:41: 00000004:00000024:3.0:1788586838.876339:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788586838.876393:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073a1711e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127400192:12345-0@lo:41: Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586838.876400:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788586838.876671:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000054e36aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127400192:0@lo:41: 00010000:00010000:3.0:1788586839.509259:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586840.533033:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586841.558601:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586842.452801:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586842.454233:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a385954 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127400320:0@lo:41: 00000100:00100000:2.0:1788586842.454329:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586842.454439:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400320 00000100:00100000:2.0:1788586842.454447:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400320 00000100:00100000:2.0:1788586842.454507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586842.454516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003228196 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127400320:12345-0@lo:41: 00000004:00000024:2.0:1788586842.454556:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788586842.454606:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003228196 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127400320:12345-0@lo:41: Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586842.454613:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586842.454669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a385954 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127400320:0@lo:41: 00000100:00100000:3.0:1788586842.454964:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047f91d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127400832:0@lo:400: 00000100:00100000:3.0:1788586842.455017:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586842.455017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7ae6cbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127400448:0@lo:400: 00000100:00100000:3.0:1788586842.455046:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586842.455053:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057bbd073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127400704:0@lo:400: 00000100:00100000:0.0:1788586842.455067:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586842.455087:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586842.455102:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586842.455111:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000106762fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127400576:0@lo:400: 00000100:00100000:3.0:1788586842.455120:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400704 00000100:00100000:3.0:1788586842.455125:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400704 00000100:00100000:3.0:1788586842.455153:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586842.455160:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000705bbc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127400704:12345-0@lo:400: 00000100:00100000:3.0:1788586842.455195:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000705bbc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127400704:12345-0@lo:400: Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586842.455202:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586842.455225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057bbd073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127400704:0@lo:400: 00000100:00100000:0.0:1788586842.455412:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586842.455466:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400832 00000100:00100000:0.0:1788586842.455471:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400832 00000100:00100000:0.0:1788586842.455510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400576 00000100:00100000:0.0:1788586842.455513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400576 00000100:00100000:0.0:1788586842.455528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586842.455534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a21e29f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127400832:12345-0@lo:400: 00000100:00100000:0.0:1788586842.455572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a21e29f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127400832:12345-0@lo:400: Request processed in 39us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586842.455579:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586842.455591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788586842.455596:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003962f181 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127400576:12345-0@lo:400: 00000100:00100000:0.0:1788586842.455622:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003962f181 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127400576:12345-0@lo:400: Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586842.455628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788586842.455644:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400448 00000100:00100000:0.0:1788586842.455647:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400448 00000100:00100000:0.0:1788586842.455668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788586842.455674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047883d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3646:x1875469127400448:12345-0@lo:400: 00000100:00100000:0.0:1788586842.455700:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047883d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3646:x1875469127400448:12345-0@lo:400: Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586842.455705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788586842.455747:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000047f91d5b x1875469127400832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586842.455765:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047f91d5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127400832:0@lo:400: 00010000:00080000:0.0:1788586842.455786:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000106762fe x1875469127400576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586842.455794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000106762fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127400576:0@lo:400: 00000100:00100000:0.0:1788586842.455801:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7ae6cbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127400448:0@lo:400: 00010000:00010000:2.0:1788586842.581204:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586843.607206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586843.993007:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127400960:0@lo:41: 00000100:00100000:1.0:1788586843.993072:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586843.997431:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127400960 00000100:00100000:2.0:1788586843.997445:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127400960 00000100:00100000:2.0:1788586843.997508:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788586843.997517:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e699541 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127400960:12345-0@lo:41: 00000004:00000024:2.0:1788586843.997556:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788586844.000209:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e699541 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127400960:12345-0@lo:41: Request processed in 2687us (7131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586844.000223:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788586844.000289:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd39d0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127400960:0@lo:41: 00010000:00010000:2.0:1788586844.628552:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788586845.014611:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586845.014620:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5baaa5e000 from 1 10000000:01000000:2.0:1788586845.014625:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586845.014675:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: 00000000286a649b/0xfbc93bbea5fd95a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586845.014702:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: 00000000286a649b/0xfbc93bbea5fd95a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586845.014714:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: 00000000286a649b/0xfbc93bbea5fd95a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586845.014737:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b975032b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401088:0@lo:101: 00000100:00100000:2.0:1788586845.014798:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586845.014852:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8a69b9e going to sleep for 11 seconds 00000100:00100000:0.0:1788586845.015570:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401088 00000100:00100000:0.0:1788586845.015578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401088 00000100:00100000:0.0:1788586845.015632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788586845.015641:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd4456b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127401088:12345-0@lo:101: 00010000:00010000:0.0:1788586845.015654:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586845.015679:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b536533/0xfbc93bbea5fd95a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd95a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.015703:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b536533/0xfbc93bbea5fd95a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.015713:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b536533/0xfbc93bbea5fd95a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.015721:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b536533, rc 0) 00000100:00100000:0.0:1788586845.015775:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd4456b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127401088:12345-0@lo:101: Request processed in 136us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586845.015781:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586845.015916:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b975032b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401088:0@lo:101: 00010000:00010000:3.0:1788586845.015932:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: 00000000286a649b/0xfbc93bbea5fd95a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586845.015940:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: 00000000286a649b/0xfbc93bbea5fd95a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586845.015999:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057bbd073 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401216:0@lo:501: 00000100:00100000:3.0:1788586845.016041:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586845.016068:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099ba2757 going to sleep for 11 seconds 00000100:00100000:0.0:1788586845.016147:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401216 00000100:00100000:0.0:1788586845.016151:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401216 00000100:00100000:0.0:1788586845.016191:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788586845.016197:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f8d796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127401216:12345-0@lo:501: 00000100:00100000:0.0:1788586845.016311:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f8d796 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127401216:12345-0@lo:501: Request processed in 115us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586845.016317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788586845.016633:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057bbd073 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401216:0@lo:501: 00000100:00100000:0.0:1788586845.016730:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029675dc2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401344:0@lo:503: 00000100:00100000:0.0:1788586845.016773:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586845.016795:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e02d9c2e going to sleep for 11 seconds 00000100:00100000:0.0:1788586845.016807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401344 00000100:00100000:0.0:1788586845.016810:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401344 00000100:00100000:0.0:1788586845.016834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788586845.016840:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8caf0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127401344:12345-0@lo:503: 00000100:00100000:0.0:1788586845.016930:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8caf0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127401344:12345-0@lo:503: Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586845.016937:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788586845.016975:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029675dc2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401344:0@lo:503: 00000100:00100000:3.0:1788586845.018906:0:8297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025bdff9f pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8297:1875469127401472:0@lo:502: 00000100:00100000:3.0:1788586845.018978:0:8297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586845.019028:0:8297:0:(client.c:2716:ptlrpc_set_wait()) set 00000000440c6969 going to sleep for 11 seconds 00000100:00100000:0.0:1788586845.020094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401472 00000100:00100000:0.0:1788586845.020104:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401472 00000100:00100000:0.0:1788586845.020160:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788586845.020168:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a2194eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:8297:x1875469127401472:12345-0@lo:502: 00000100:00100000:0.0:1788586845.020314:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a2194eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:8297:x1875469127401472:12345-0@lo:502: Request processed in 147us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586845.020321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788586845.020601:0:8297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025bdff9f pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8297:1875469127401472:0@lo:502: 00000020:01000000:3.0:1788586845.020641:0:8297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586845.020651:0:8297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586845.020653:0:8297:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788586845.020659:0:8297:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5baaa5e000 00000020:00000080:3.0:1788586845.020662:0:8297:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788586845.020720:0:8297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8297:1875469127401600:0@lo:502: 00000100:00100000:3.0:1788586845.020760:0:8297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586845.020794:0:8297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbace40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586845.020893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401600 00000100:00100000:1.0:1788586845.020897:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401600 00000100:00100000:1.0:1788586845.020934:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788586845.020942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8297:x1875469127401600:12345-0@lo:502: 00000100:00100000:1.0:1788586845.021030:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8297:x1875469127401600:12345-0@lo:502: Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586845.021037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788586845.021217:0:8297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8297:1875469127401600:0@lo:502: 00000020:01000000:3.0:1788586845.021236:0:8297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586845.021240:0:8297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586845.021242:0:8297:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788586845.021245:0:8297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788586845.022834:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788586845.022867:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586845.022897:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.022910:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586845.022920:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788586845.022923:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5b86e73000 from 1 10000000:01000000:0.0:1788586845.022925:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788586845.022957:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.022965:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.022974:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586845.022995:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401728:0@lo:101: 00000100:00100000:0.0:1788586845.023099:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586845.023146:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586845.023812:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401728 00000100:00100000:3.0:1788586845.023821:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401728 00000100:00100000:3.0:1788586845.023872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788586845.023882:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127401728:12345-0@lo:101: 00010000:00010000:3.0:1788586845.023895:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586845.023909:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd95ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586845.023933:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586845.023944:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586845.023953:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecca00, rc 0) 00000100:00100000:3.0:1788586845.023997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127401728:12345-0@lo:101: Request processed in 117us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586845.024194:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401728:0@lo:101: 00010000:00010000:0.0:1788586845.024209:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586845.024219:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586845.025544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788586845.025682:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401856:0@lo:501: 00000100:00100000:0.0:1788586845.025725:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586845.025773:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586845.026021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401856 00000100:00100000:3.0:1788586845.026029:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401856 00000100:00100000:3.0:1788586845.026064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788586845.026077:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127401856:12345-0@lo:501: 00000100:00100000:3.0:1788586845.026203:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127401856:12345-0@lo:501: Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586845.026210:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788586845.027385:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401856:0@lo:501: 00000100:00100000:0.0:1788586845.027479:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401984:0@lo:503: 00000100:00100000:0.0:1788586845.027544:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586845.027577:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586845.027646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127401984 00000100:00100000:3.0:1788586845.027652:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127401984 00000100:00100000:3.0:1788586845.027707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788586845.027718:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127401984:12345-0@lo:503: 00000100:00100000:3.0:1788586845.027825:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127401984:12345-0@lo:503: Request processed in 109us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586845.027833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788586845.028152:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127401984:0@lo:503: 00000100:00100000:0.0:1788586845.029009:0:8299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8299:1875469127402112:0@lo:502: 00000100:00100000:0.0:1788586845.029060:0:8299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586845.029095:0:8299:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88876600 going to sleep for 11 seconds 00000100:00100000:1.0:1788586845.029143:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402112 00000100:00100000:1.0:1788586845.029149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402112 00000100:00100000:1.0:1788586845.029188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788586845.029196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8299:x1875469127402112:12345-0@lo:502: 00000100:00100000:1.0:1788586845.029300:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8299:x1875469127402112:12345-0@lo:502: Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586845.029307:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788586845.029551:0:8299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8299:1875469127402112:0@lo:502: 00000020:01000000:0.0:1788586845.029574:0:8299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586845.029585:0:8299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586845.029587:0:8299:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788586845.029594:0:8299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5b86e73000 00000020:00000080:0.0:1788586845.029596:0:8299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788586845.029615:0:8299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8299:1875469127402240:0@lo:502: 00000100:00100000:0.0:1788586845.029647:0:8299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586845.029678:0:8299:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88876600 going to sleep for 11 seconds 00000100:00100000:1.0:1788586845.029802:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402240 00000100:00100000:1.0:1788586845.029807:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402240 00000100:00100000:1.0:1788586845.029832:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788586845.029838:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8299:x1875469127402240:12345-0@lo:502: 00000100:00100000:1.0:1788586845.029908:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8299:x1875469127402240:12345-0@lo:502: Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586845.029915:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788586845.030579:0:8299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8299:1875469127402240:0@lo:502: 00000020:01000000:0.0:1788586845.030605:0:8299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586845.030610:0:8299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586845.030613:0:8299:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788586845.030616:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788586845.031658:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788586845.031693:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586845.031704:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586845.031715:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586845.652857:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586846.676804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788586847.356182:0:8427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788586847.356186:0:8427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788586847.356187:0:8427:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788586847.356291:0:8427:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f5bae583000 00000020:01000004:3.0:1788586847.356307:0:8427:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788586847.356318:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788586847.356333:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f5bae574d40) 00000020:00000080:3.0:1788586847.356349:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788586847.403638:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788586847.403699:0:8427:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788586847.429777:0:8427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788586847.429985:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788586847.429996:0:8427:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788586847.430009:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfbc93bbea5fd95c3 00000020:01000004:3.0:1788586847.430016:0:8427:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788586847.430038:0:8427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788586847.430042:0:8427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788586847.430048:0:8427:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788586847.430052:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788586847.430074:0:8427:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f5baf193380) 00000020:00000080:3.0:1788586847.430086:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788586847.434838:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586847.435010:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788586847.435016:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788586847.436102:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788586847.436112:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788586847.441788:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788586847.441803:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788586847.446457:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586847.447348:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788586847.447356:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788586847.449595:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788586847.449606:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788586847.486023:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586847.486265:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788586847.486272:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788586847.489079:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788586847.489094:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788586847.491044:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788586847.491057:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788586847.494702:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586847.494901:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788586847.494908:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788586847.496194:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788586847.496212:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788586847.574941:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586847.574967:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127402368:0@lo:41: 00000100:00100000:2.0:1788586847.575032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.575104:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402368 00000100:00100000:2.0:1788586847.575112:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402368 00000100:00100000:2.0:1788586847.575156:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586847.575165:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127402368:12345-0@lo:41: 00000004:00000024:2.0:1788586847.575195:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788586847.575239:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127402368:12345-0@lo:41: Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.575247:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586847.575291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127402368:0@lo:41: 00000100:00100000:1.0:1788586847.577551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127402880:0@lo:400: 00000100:00100000:1.0:1788586847.577609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.577643:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586847.577648:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127402752:0@lo:400: 00000100:00100000:1.0:1788586847.577670:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.577697:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402880 00000100:00100000:1.0:1788586847.577703:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402880 00000100:00100000:1.0:1788586847.577742:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788586847.577750:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127402880:12345-0@lo:400: 00000100:00100000:1.0:1788586847.577791:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127402880:12345-0@lo:400: Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.577797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788586847.577817:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402752 00000100:00100000:1.0:1788586847.577820:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402752 00000100:00100000:1.0:1788586847.577838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586847.577854:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127402752:12345-0@lo:400: 00000100:00100000:1.0:1788586847.577883:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127402752:12345-0@lo:400: Request processed in 29us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.577889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586847.577947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127402752:0@lo:400: 00010000:00080000:1.0:1788586847.577959:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5bb05adf80 x1875469127402880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586847.577969:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127402880:0@lo:400: 00000100:00100000:0.0:1788586847.578137:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127402624:0@lo:400: 00000100:00100000:0.0:1788586847.578164:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586847.578190:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586847.578195:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127402496:0@lo:400: 00000100:00100000:0.0:1788586847.578219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.579434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402624 00000100:00100000:1.0:1788586847.579455:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402624 00000100:00100000:1.0:1788586847.579508:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788586847.579516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127402624:12345-0@lo:400: 00000100:00100000:1.0:1788586847.579588:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127402624:12345-0@lo:400: Request processed in 72us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.579595:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788586847.579616:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127402496 00000100:00100000:1.0:1788586847.579620:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127402496 00000100:00100000:1.0:1788586847.579646:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788586847.579652:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3649:x1875469127402496:12345-0@lo:400: 00000100:00100000:1.0:1788586847.579681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3649:x1875469127402496:12345-0@lo:400: Request processed in 29us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.579686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788586847.579788:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127402496:0@lo:400: 00010000:00080000:2.0:1788586847.579803:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5bb05ad180 x1875469127402624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586847.579822:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127402624:0@lo:400: 00000100:00100000:3.0:1788586847.593790:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586847.594214:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788586847.594221:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788586847.596002:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788586847.596017:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788586847.596667:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788586847.596718:0:8427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788586847.596725:0:8427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788586847.620672:0:8427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788586847.620712:0:8427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.101@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788586847.620716:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788586847.620718:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788586847.620724:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586847.620725:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586847.620727:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586847.620729:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586847.620730:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586847.620731:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586847.620733:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586847.620734:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586847.620735:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788586847.620739:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788586847.620741:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788586847.620742:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788586847.620743:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586847.620744:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586847.620745:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586847.620746:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586847.620747:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586847.620748:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586847.620749:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586847.620750:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586847.620751:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788586847.620844:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788586847.620863:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127403008:0@lo:253: 00000100:00100000:1.0:1788586847.621017:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.621180:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82dd2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788586847.621227:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403008 00000100:00100000:0.0:1788586847.621234:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403008 00000100:00100000:0.0:1788586847.621283:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788586847.621293:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8427:x1875469127403008:12345-0@lo:253: 20000000:01000000:0.0:1788586847.621323:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788586847.621327:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788586847.621332:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788586847.621336:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788586847.621594:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586847.621715:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788586847.621729:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788586847.622254:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788586847.622263:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788586847.622278:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788586847.622291:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788586847.622367:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788586847.622380:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.101@tcp 20000000:01000000:0.0:1788586847.622382:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:0.0:1788586847.622393:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788586847.622398:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788586847.622584:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788586847.622598:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:0.0:1788586847.622611:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788586847.622617:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788586847.622627:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788586847.622640:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788586847.622699:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788586847.622709:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.101@tcp 20000000:01000000:0.0:1788586847.622711:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:0.0:1788586847.622721:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788586847.622726:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788586847.622736:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788586847.622740:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:0.0:1788586847.622752:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788586847.622821:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788586847.622836:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788586847.622849:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788586847.623364:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788586847.623375:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.101@tcp 20000000:01000000:0.0:1788586847.623376:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:0.0:1788586847.623528:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788586847.623537:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788586847.623553:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788586847.623557:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:0.0:1788586847.623568:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788586847.623573:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788586847.623584:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788586847.623596:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788586847.623608:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788586847.623610:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788586847.623613:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788586847.623653:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788586847.623660:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788586847.624691:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788586847.624725:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788586847.624739:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788586847.625167:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788586847.625187:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788586847.625199:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788586847.625210:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788586847.625212:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788586847.630234:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788586847.630293:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788586847.630315:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788586847.630890:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788586847.630917:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788586847.630932:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788586847.630943:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788586847.630946:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788586847.631360:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788586847.631705:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788586847.631727:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788586847.631743:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788586847.631751:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788586847.631821:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788586847.632117:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788586847.632137:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788586847.632153:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788586847.632305:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788586847.632323:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788586847.632337:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1788586847.632351:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788586847.632369:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632387:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632395:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632402:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632409:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632578:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632586:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632626:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632641:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 18 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.632656:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403136:0@lo:104: 00000100:00100000:0.0:1788586847.632729:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586847.632883:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.632891:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 18 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.632899:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403264:0@lo:104: 00000100:00100000:0.0:1788586847.632932:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586847.633006:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.633015:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 18 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.633023:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403392:0@lo:104: 00000100:00100000:0.0:1788586847.633051:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.633114:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403136 00000100:00100000:2.0:1788586847.633120:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403136 00000100:00100000:2.0:1788586847.633155:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403264 00000100:00100000:2.0:1788586847.633158:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403264 00000100:00100000:2.0:1788586847.633171:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586847.633179:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6514:x1875469127403136:12345-0@lo:104: 00010000:00010000:2.0:1788586847.633195:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633240:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586847.633246:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6514:x1875469127403136:12345-0@lo:104: Request processed in 67us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.633252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586847.633267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586847.633273:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6514:x1875469127403264:12345-0@lo:104: 00010000:00010000:2.0:1788586847.633280:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633309:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788586847.633313:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6514:x1875469127403264:12345-0@lo:104: Request processed in 41us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.633319:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788586847.633333:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586847.633339:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633356:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586847.633360:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633367:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586847.633373:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586847.633379:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586847.633448:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633455:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586847.633472:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633478:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050000/0xfbc93bbea5fd958b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9592 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633492:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586847.633495:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633501:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051e00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586847.633504:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633521:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586847.633527:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586847.633532:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586847.633546:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633551:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586847.633556:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633562:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051e00/0xfbc93bbea5fd9561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9568 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633573:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.633574:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.633576:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.633582:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586847.633592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127403520:0@lo:103: 00000100:00100000:2.0:1788586847.633620:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.633643:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586847.633649:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127403648:0@lo:103: 00000100:00100000:2.0:1788586847.633668:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.633691:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403520 00000100:00100000:2.0:1788586847.633695:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403520 00010000:00010000:2.0:1788586847.633711:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 19 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.633736:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403648 00000100:00100000:2.0:1788586847.633740:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403648 00010000:00010000:2.0:1788586847.633751:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 20 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.633774:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586847.633780:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3648:x1875469127403520:12345-0@lo:103: 00010000:00010000:2.0:1788586847.633790:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.633795:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 20 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633805:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 20 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633820:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.633847:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3648:x1875469127403520:12345-0@lo:103: Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.633853:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586847.633867:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586847.633873:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3648:x1875469127403648:12345-0@lo:103: 00010000:00010000:2.0:1788586847.633880:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.633884:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 19 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633892:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 19 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.633902:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.633929:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3648:x1875469127403648:12345-0@lo:103: Request processed in 56us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.633935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586847.633972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127403648:0@lo:103: 00000100:00100000:2.0:1788586847.633980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127403520:0@lo:103: 00010000:00010000:0.0:1788586847.634282:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.634292:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 18 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.634301:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403776:0@lo:104: 00000100:00100000:0.0:1788586847.634322:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586847.634338:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.634345:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 18 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.634352:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403904:0@lo:104: 00000100:00100000:0.0:1788586847.634368:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586847.634377:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b888769c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788586847.634388:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9592 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd958b expref: 18 pid: 6514 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.634399:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403136:0@lo:104: 00010000:00010000:0.0:1788586847.634407:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9561 expref: 17 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.634439:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403264:0@lo:104: 00000100:00100000:2.0:1788586847.634506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403392 00000100:00100000:2.0:1788586847.634511:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403392 00000100:00100000:2.0:1788586847.634530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403776 00000100:00100000:2.0:1788586847.634533:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403776 00000100:00100000:2.0:1788586847.634540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127403904 00000100:00100000:2.0:1788586847.634542:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127403904 00000100:00100000:2.0:1788586847.634551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586847.634557:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6514:x1875469127403392:12345-0@lo:104: 00010000:00010000:2.0:1788586847.634565:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634614:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586847.634619:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6514:x1875469127403392:12345-0@lo:104: Request processed in 63us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.634624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586847.634638:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586847.634643:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6514:x1875469127403776:12345-0@lo:104: 00010000:00010000:2.0:1788586847.634649:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634677:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788586847.634681:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6514:x1875469127403776:12345-0@lo:104: Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.634696:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586847.634707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788586847.634712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6514:x1875469127403904:12345-0@lo:104: 00010000:00010000:2.0:1788586847.634720:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634744:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788586847.634748:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6514:x1875469127403904:12345-0@lo:104: Request processed in 36us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.634819:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788586847.634835:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788586847.634841:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634847:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586847.634851:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634858:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586847.634864:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586847.634869:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586847.634887:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634893:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586847.634915:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634920:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd800/0xfbc93bbea5fd9545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd954c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634931:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586847.634933:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634938:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586847.634941:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634947:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586847.634953:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586847.634958:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586847.634970:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634976:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586847.634980:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634984:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd950d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9514 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.634993:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586847.635003:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635008:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586847.635010:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635016:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586847.635021:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586847.635026:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586847.635037:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635042:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586847.635052:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635058:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd200/0xfbc93bbea5fd9496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd949d expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635070:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.635071:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.635073:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586847.635085:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127404032:0@lo:103: 00000100:00100000:2.0:1788586847.635111:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.635129:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586847.635135:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127404160:0@lo:103: 00000100:00100000:2.0:1788586847.635161:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.635188:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404032 00000100:00100000:2.0:1788586847.635192:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404032 00010000:00010000:2.0:1788586847.635206:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 17 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.635224:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404160 00000100:00100000:2.0:1788586847.635227:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404160 00010000:00010000:2.0:1788586847.635237:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 18 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.635249:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586847.635254:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3646:x1875469127404032:12345-0@lo:103: 00010000:00010000:2.0:1788586847.635275:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.635281:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 18 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635291:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 18 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635302:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.635328:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3646:x1875469127404032:12345-0@lo:103: Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.635335:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586847.635348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586847.635353:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3646:x1875469127404160:12345-0@lo:103: 00010000:00010000:2.0:1788586847.635359:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.635363:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 17 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635380:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 17 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635388:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.635410:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3646:x1875469127404160:12345-0@lo:103: Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.635451:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586847.635481:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127404160:0@lo:103: 00000100:00100000:2.0:1788586847.635490:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127404032:0@lo:103: 00000100:00100000:2.0:1788586847.635508:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127404288:0@lo:103: 00000100:00100000:2.0:1788586847.635532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586847.635554:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586847.635562:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404288 00000100:00100000:2.0:1788586847.635566:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404288 00010000:00010000:2.0:1788586847.635579:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 17 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.635597:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788586847.635602:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3648:x1875469127404288:12345-0@lo:103: 00010000:00010000:2.0:1788586847.635609:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.635612:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 17 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635620:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 17 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635632:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635647:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635660:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635666:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635672:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635678:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635683:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788586847.635687:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635696:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635704:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.635711:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.635737:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3648:x1875469127404288:12345-0@lo:103: Request processed in 135us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.635743:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788586847.635940:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050200/0xfbc93bbea5fd954c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9545 expref: 16 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.635951:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403392:0@lo:104: 00010000:00010000:0.0:1788586847.635970:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd950d expref: 15 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.635981:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403776:0@lo:104: 00010000:00010000:0.0:1788586847.635991:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fd949d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9496 expref: 14 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586847.636000:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127403904:0@lo:104: 00010000:00010000:0.0:1788586847.636018:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.636025:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.636031:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.636036:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd95d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586847.636049:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788586847.636412:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127404288:0@lo:103: 00000100:00100000:0.0:1788586847.640019:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:8427:x1875469127403008:12345-0@lo:253: Request processed in 18718us (18992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586847.640034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788586847.640375:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127403008:0@lo:253: 10000000:01000000:1.0:1788586847.640394:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788586847.640397:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788586847.640399:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788586847.640401:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586847.640463:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788586847.640464:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586847.640466:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586847.640467:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586847.640469:0:8427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788586847.640471:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586847.640472:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788586847.640495:0:8427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5bae583000 from lustre-OST0000 10000000:01000000:1.0:1788586847.640527:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788586847.640530:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788586847.640539:0:8427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f5bb05e3380 local copy 10000000:01000000:1.0:1788586847.640543:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788586847.640581:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.640591:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.640600:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586847.640617:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404416:0@lo:101: 00000100:00100000:1.0:1788586847.640659:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.640694:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.641232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404416 00000100:00100000:3.0:1788586847.641238:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404416 00000100:00100000:3.0:1788586847.641290:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788586847.641303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:8427:x1875469127404416:12345-0@lo:101: 00010000:00010000:3.0:1788586847.641334:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586847.641349:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd95df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd95d8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.641378:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd95df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95d8 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.641389:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd95df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95d8 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.641397:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd400, rc 0) 00000100:00100000:3.0:1788586847.641471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127404416:12345-0@lo:101: Request processed in 173us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.641478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788586847.642254:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404416:0@lo:101: 00010000:00010000:1.0:1788586847.642272:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.642284:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586847.642392:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404544:0@lo:501: 00000100:00100000:1.0:1788586847.642482:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.642520:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586847.642607:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404544 00000100:00100000:0.0:1788586847.642613:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404544 00000100:00100000:0.0:1788586847.642650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788586847.642658:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127404544:12345-0@lo:501: 00000100:00100000:0.0:1788586847.642718:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127404544:12345-0@lo:501: Request processed in 61us (236us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586847.642732:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788586847.644059:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404544:0@lo:501: 10000000:01000000:3.0:1788586847.644098:0:8427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788586847.644133:0:8427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788586847.644141:0:8427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.644152:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.644159:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.644182:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788586847.644210:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5bae583000 10000000:01000000:3.0:1788586847.644225:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788586847.644232:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788586847.644234:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788586847.644239:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788586847.644242:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586847.644608:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.644617:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.644628:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586847.644646:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404672:0@lo:101: 00000100:00100000:3.0:1788586847.644695:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586847.644739:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb10000 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.644761:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404672 00000100:00100000:1.0:1788586847.644769:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404672 00000100:00100000:1.0:1788586847.644805:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788586847.644813:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127404672:12345-0@lo:101: 00010000:00010000:1.0:1788586847.644824:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586847.644837:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd95e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.644859:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.644870:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.644879:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318be00, rc 0) 00000100:00100000:1.0:1788586847.644925:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127404672:12345-0@lo:101: Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.644931:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1788586847.645046:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586847.645053:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.645060:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318bc00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586847.645063:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.645071:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586847.645079:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586847.645084:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586847.645104:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.645110:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586847.645139:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.645146:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318bc00/0xfbc93bbea5fd95d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd95df expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.645157:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.645159:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.645160:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586847.645167:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586847.645177:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127404800:0@lo:103: 00000100:00100000:2.0:1788586847.645217:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.645244:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404800 00000100:00100000:2.0:1788586847.645247:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404800 00000100:00100000:2.0:1788586847.645473:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586847.645481:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788586847.645483:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3648:x1875469127404800:12345-0@lo:103: 00000100:00100000:0.0:1788586847.645495:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788586847.645497:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.645512:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd95df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd95d8 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.645523:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.645567:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:3648:x1875469127404800:12345-0@lo:103: Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.645574:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586847.645707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127404800:0@lo:103: 00000100:00100000:3.0:1788586847.645890:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404672:0@lo:101: 00010000:00010000:3.0:1788586847.645904:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.645913:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586847.646226:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404928:0@lo:501: 00000100:00100000:3.0:1788586847.646785:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586847.646865:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb10000 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.648848:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127404928 00000100:00100000:1.0:1788586847.648864:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127404928 00000100:00100000:1.0:1788586847.649015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788586847.649028:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127404928:12345-0@lo:501: 00000100:00100000:1.0:1788586847.649209:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127404928:12345-0@lo:501: Request processed in 184us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.649217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788586847.649380:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127404928:0@lo:501: 00000100:00100000:0.0:1788586847.649458:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405056:0@lo:503: 00000100:00100000:0.0:1788586847.649514:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586847.650519:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88876480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.650729:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405056 00000100:00100000:3.0:1788586847.650735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405056 00000100:00100000:3.0:1788586847.650773:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788586847.650791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405056:12345-0@lo:503: 00000100:00100000:3.0:1788586847.650909:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405056:12345-0@lo:503: Request processed in 118us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.650915:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788586847.653188:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405056:0@lo:503: 00000040:00080000:0.0:1788586847.653527:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788586847.653629:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405184:0@lo:502: 00000100:00100000:0.0:1788586847.653703:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586847.653734:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88876480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.654723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405184 00000100:00100000:3.0:1788586847.654732:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405184 00000100:00100000:3.0:1788586847.654763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788586847.654772:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405184:12345-0@lo:502: 00000100:00100000:3.0:1788586847.654893:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405184:12345-0@lo:502: Request processed in 121us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.654900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788586847.655382:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405184:0@lo:502: 00000040:00080000:0.0:1788586847.656139:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788586847.656179:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788586847.656195:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788586847.656208:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788586847.656221:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788586847.656236:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788586847.656345:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405312:0@lo:502: 00000100:00100000:0.0:1788586847.656410:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586847.656487:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88876480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.656713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405312 00000100:00100000:3.0:1788586847.656721:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405312 00000100:00100000:3.0:1788586847.656756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788586847.656765:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405312:12345-0@lo:502: 00000100:00100000:3.0:1788586847.656874:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405312:12345-0@lo:502: Request processed in 110us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.656882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788586847.657352:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405312:0@lo:502: 00000040:00080000:0.0:1788586847.657450:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788586847.657470:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788586847.659847:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788586847.659859:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788586847.659865:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586847.659867:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788586847.659877:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788586847.659893:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f5ba7ab3380) 00000020:00000080:2.0:1788586847.659916:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788586847.659921:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788586847.659993:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bae583000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788586847.660001:0:8451:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788586847.660008:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfbc93bbea5fd95fb 00010000:00010000:2.0:1788586847.667031:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788586847.667950:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788586847.673645:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788586847.674052:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788586847.687712:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788586847.688666:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788586847.700240:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1788586847.704698:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788586847.707587:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788586847.707599:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586847.707605:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586847.707608:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788586847.707612:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586847.707616:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586847.707617:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586847.707620:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586847.707623:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788586847.707645:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586847.707648:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586847.707649:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788586847.707652:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788586847.707769:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788586847.707797:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788586847.707810:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.707823:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586847.707831:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bae583000 from 1 10000000:01000000:3.0:1788586847.707848:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788586847.707882:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.707891:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.707902:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586847.707936:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405440:0@lo:101: 00000100:00100000:3.0:1788586847.707998:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586847.708040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405440 00000100:00100000:3.0:1788586847.708047:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405440 00000100:00100000:3.0:1788586847.708086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788586847.708094:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:8427:x1875469127405440:12345-0@lo:101: 00010000:00010000:3.0:1788586847.708106:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586847.708128:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9602 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.708150:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.708161:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.708170:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd600, rc 0) 00000100:00100000:3.0:1788586847.708205:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405440:12345-0@lo:101: Request processed in 111us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.708211:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788586847.708267:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.708288:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405440:0@lo:101: 00010000:00010000:3.0:1788586847.708303:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.708310:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586847.708386:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405568:0@lo:501: 00000100:00100000:3.0:1788586847.708411:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586847.708457:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.708892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405568 00000100:00100000:1.0:1788586847.708905:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405568 00000100:00100000:1.0:1788586847.708949:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788586847.708957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405568:12345-0@lo:501: 00000100:00100000:1.0:1788586847.709068:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405568:12345-0@lo:501: Request processed in 112us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.709075:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788586847.709679:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405568:0@lo:501: 00000100:00100000:3.0:1788586847.709720:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405696:0@lo:503: 00000100:00100000:3.0:1788586847.709774:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586847.709805:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb100c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.709910:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405696 00000100:00100000:1.0:1788586847.709915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405696 00000100:00100000:1.0:1788586847.709962:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788586847.709970:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405696:12345-0@lo:503: 00000100:00100000:1.0:1788586847.710059:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405696:12345-0@lo:503: Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.710066:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788586847.710106:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405696:0@lo:503: 00000040:00080000:1.0:1788586847.710360:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586847.710469:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405824:0@lo:502: 00000100:00100000:1.0:1788586847.710505:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.710519:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.712595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405824 00000100:00100000:3.0:1788586847.712609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405824 00000100:00100000:3.0:1788586847.712655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788586847.712665:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405824:12345-0@lo:502: 00000100:00100000:3.0:1788586847.712825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405824:12345-0@lo:502: Request processed in 161us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.712832:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788586847.715578:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405824:0@lo:502: 00000040:00080000:1.0:1788586847.715841:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788586847.715867:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788586847.715899:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405952:0@lo:502: 00000100:00100000:1.0:1788586847.715969:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.716007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127405952 00000100:00100000:1.0:1788586847.716012:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127405952 00000100:00100000:1.0:1788586847.716050:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788586847.716057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405952:12345-0@lo:502: 00000100:00100000:1.0:1788586847.716147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127405952:12345-0@lo:502: Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.716154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788586847.716199:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.716210:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127405952:0@lo:502: 00000040:00080000:1.0:1788586847.716240:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788586847.716246:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788586847.717509:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586847.717520:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586847.717522:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788586847.717529:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5bae583000 00000020:00000080:2.0:1788586847.717533:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788586847.717545:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586847.717548:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586847.717549:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788586847.717552:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788586847.717968:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788586847.717996:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586847.718020:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.718030:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586847.718072:0:8427:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788586847.718075:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5bae583000 10000000:01000000:1.0:1788586847.718078:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5bae583000 10000000:01000000:1.0:1788586847.718081:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586847.718086:0:8427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5bae583000 from 1 10000000:01000000:1.0:1788586847.718088:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586847.718131:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.718138:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.718148:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586847.718180:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406080:0@lo:101: 00000100:00100000:1.0:1788586847.718237:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.718271:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788586847.718341:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406080 00000100:00100000:0.0:1788586847.718348:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406080 00000100:00100000:0.0:1788586847.718389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788586847.718398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8427:x1875469127406080:12345-0@lo:101: 00010000:00010000:0.0:1788586847.718408:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586847.718437:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9610 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.718477:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.718489:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.718497:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030a00, rc 0) 00000100:00100000:0.0:1788586847.718532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406080:12345-0@lo:101: Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586847.718538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788586847.718859:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406080:0@lo:101: 00010000:00010000:1.0:1788586847.718873:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586847.718882:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586847.718983:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406208:0@lo:501: 00000100:00100000:1.0:1788586847.719008:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.719036:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788586847.719196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406208 00000100:00100000:0.0:1788586847.719201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406208 00000100:00100000:0.0:1788586847.719229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788586847.719235:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406208:12345-0@lo:501: 00000100:00100000:0.0:1788586847.719331:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406208:12345-0@lo:501: Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586847.719337:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788586847.719396:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406208:0@lo:501: 00000100:00100000:2.0:1788586847.719457:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406336:0@lo:503: 00000100:00100000:2.0:1788586847.719500:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.719517:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad65e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.719614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406336 00000100:00100000:1.0:1788586847.719618:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406336 00000100:00100000:1.0:1788586847.719650:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788586847.719657:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406336:12345-0@lo:503: 00000100:00100000:1.0:1788586847.719731:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406336:12345-0@lo:503: Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.719737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788586847.719888:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406336:0@lo:503: 00000040:00080000:1.0:1788586847.720630:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586847.720697:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406464:0@lo:502: 00000100:00100000:1.0:1788586847.720744:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586847.720869:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788586847.723155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406464 00000100:00100000:0.0:1788586847.723166:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406464 00000100:00100000:0.0:1788586847.723253:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788586847.723264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406464:12345-0@lo:502: 00000100:00100000:0.0:1788586847.723451:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406464:12345-0@lo:502: Request processed in 189us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586847.723467:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788586847.723557:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406464:0@lo:502: 00000040:00080000:2.0:1788586847.724337:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788586847.724376:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788586847.724392:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788586847.724404:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788586847.724452:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788586847.724479:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788586847.724494:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788586847.724506:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788586847.724519:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788586847.724533:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788586847.724547:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788586847.724561:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788586847.724573:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788586847.724585:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788586847.724598:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788586847.724628:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788586847.724643:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788586847.724656:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788586847.724685:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788586847.724700:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788586847.724714:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788586847.724728:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788586847.724741:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788586847.724767:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788586847.724783:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788586847.724797:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788586847.724809:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788586847.724821:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788586847.724834:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788586847.724845:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788586847.724858:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788586847.724872:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788586847.724885:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788586847.724899:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788586847.724928:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788586847.724943:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788586847.724955:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788586847.724995:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406592:0@lo:502: 00000100:00100000:2.0:1788586847.725055:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.726375:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad65e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586847.726603:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406592 00000100:00100000:1.0:1788586847.726612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406592 00000100:00100000:1.0:1788586847.726657:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788586847.726668:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406592:12345-0@lo:502: 00000100:00100000:1.0:1788586847.726823:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406592:12345-0@lo:502: Request processed in 156us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.726831:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788586847.726966:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406592:0@lo:502: 00000040:00080000:2.0:1788586847.727033:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788586847.727046:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788586847.727743:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788586847.727769:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f5ba7ab0000) 00000020:00000080:2.0:1788586847.727792:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788586847.727875:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bae583000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788586847.727880:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bae583000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788586847.727882:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bae583000 3 00010000:00080000:2.0:1788586847.727920:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a822e2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788586847.734821:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788586847.735011:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788586847.735068:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586847.735082:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfbc93bbea5fd9625 00000100:00080000:1.0:1788586847.735092:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586847.735100:0:8456:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f5a822e2000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586847.735139:0:8456:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb05ae680 x1875469127406720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586847.735166:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788586847.735268:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127406720:0@lo:38: 00000100:00100000:3.0:1788586847.735332:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788586847.740088:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788586847.740304:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f5a82434d40) 00000020:00000080:2.0:1788586847.740330:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788586847.740405:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bae583000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788586847.740409:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bae583000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788586847.740412:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bae583000 3 00010000:00080000:2.0:1788586847.740695:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a822e7000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.101@tcp at head 00000100:00100000:1.0:1788586847.743192:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406720 00000100:00100000:1.0:1788586847.743209:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406720 00000100:00100000:1.0:1788586847.743261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586847.743676:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875469127406720:12345-0@lo:38: 00010000:00080000:1.0:1788586847.743704:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1788586847.745385:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfbc93bbea5fd9633 00000004:00100000:1.0:1788586847.745407:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788586847.745521:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc98e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586847.745739:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875469127406720:12345-0@lo:38: Request processed in 2063us (10403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586847.745749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788586847.745819:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb05ae680 x1875469127406720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586847.745831:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788586847.745839:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788586847.745847:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788586847.745852:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788586847.745854:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788586847.745861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127406720:0@lo:38: 00010000:00010000:2.0:1788586847.746347:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788586847.749623:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788586847.749695:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788586847.749710:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xfbc93bbea5fd963a 00000100:00080000:2.0:1788586847.749722:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788586847.749730:0:8456:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f5a822e7000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788586847.750197:0:8456:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5ba7aa7100 x1875469127406848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788586847.750307:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788586847.750659:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875469127406848:0@lo:38: 00000100:00100000:0.0:1788586847.750750:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.750902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406848 00000100:00100000:2.0:1788586847.750911:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406848 00000100:00100000:2.0:1788586847.750948:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788586847.750955:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127406848:12345-0@lo:38: 00010000:00080000:2.0:1788586847.750980:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1788586847.751011:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfbc93bbea5fd9641 00000004:00100000:2.0:1788586847.751023:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788586847.751051:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586847.751102:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875469127406848:12345-0@lo:38: Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.751119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788586847.751167:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa7100 x1875469127406848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586847.751178:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586847.751185:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788586847.751191:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788586847.751195:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788586847.751197:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788586847.751202:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875469127406848:0@lo:38: 00000040:00080000:2.0:1788586847.751300:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788586847.752501:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788586847.752544:0:8427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586847.752565:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586847.752577:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788586847.752626:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788586847.752628:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788586847.752629:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586847.752630:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586847.752631:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586847.752636:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586847.752638:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586847.752639:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586847.752640:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586847.752641:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586847.752643:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788586847.752646:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788586847.752649:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788586847.752650:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788586847.752650:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586847.752651:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586847.752652:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586847.752653:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586847.752654:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586847.752655:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586847.752656:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586847.752657:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586847.752657:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788586847.752681:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788586847.752697:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406976:0@lo:253: 00000100:00100000:0.0:1788586847.752994:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586847.753068:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88876600 going to sleep for 11 seconds 00000100:00100000:2.0:1788586847.761284:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127406976 00000100:00100000:2.0:1788586847.761299:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127406976 00000100:00100000:2.0:1788586847.761366:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788586847.761375:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406976:12345-0@lo:253: 20000000:01000000:2.0:1788586847.761409:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788586847.761455:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788586847.771782:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788586847.771804:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788586847.772173:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:8427:x1875469127406976:12345-0@lo:253: Request processed in 10794us (19173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.772197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 20000000:01000000:2.0:1788586847.772518:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788586847.772523:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788586847.772558:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.772574:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.772582:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.772599:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.772634:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.772649:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 15 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.772662:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127407104:0@lo:104: 00000100:00100000:2.0:1788586847.772708:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586847.772759:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.772766:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 15 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.772774:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127407232:0@lo:104: 00000100:00100000:2.0:1788586847.772791:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad65e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586847.772844:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788586847.772860:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586847.772886:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407104 00000100:00100000:3.0:1788586847.772893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407104 00000100:00100000:3.0:1788586847.772925:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407232 00000100:00100000:3.0:1788586847.772928:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407232 00000100:00100000:3.0:1788586847.772943:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586847.772951:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb5b57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6536:x1875469127407104:12345-0@lo:104: 00010000:00010000:3.0:1788586847.772962:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773001:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586847.773007:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb5b57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6536:x1875469127407104:12345-0@lo:104: Request processed in 58us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.773015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586847.773045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788586847.773051:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127407232:12345-0@lo:104: 00010000:00010000:3.0:1788586847.773059:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773088:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586847.773093:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127407232:12345-0@lo:104: Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586847.773099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788586847.773117:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586847.773123:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773141:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050a00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586847.773145:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773153:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586847.773160:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586847.773165:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586847.773190:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773197:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586847.773211:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773218:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd955a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773233:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586847.773236:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773241:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586847.773243:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773260:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586847.773279:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586847.773284:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586847.773299:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773304:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586847.773309:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773317:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd953e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586847.773329:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586847.773331:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586847.773333:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586847.773652:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586847.773670:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127407360:0@lo:103: 00000100:00100000:2.0:1788586847.773707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.773732:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586847.773738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127407488:0@lo:103: 00000100:00100000:2.0:1788586847.773758:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586847.773791:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407360 00000100:00100000:2.0:1788586847.773795:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407360 00010000:00010000:2.0:1788586847.773813:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 16 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.773847:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407488 00000100:00100000:2.0:1788586847.773851:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407488 00010000:00010000:2.0:1788586847.773864:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 17 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.773882:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788586847.773888:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3646:x1875469127407360:12345-0@lo:103: 00010000:00010000:2.0:1788586847.773898:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.773903:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 17 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.773913:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 17 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.773927:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.773954:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3646:x1875469127407360:12345-0@lo:103: Request processed in 66us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.773961:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788586847.773985:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788586847.773991:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3646:x1875469127407488:12345-0@lo:103: 00010000:00010000:2.0:1788586847.773997:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586847.774001:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 16 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774008:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 16 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774019:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774031:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788586847.774045:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001924231s 00010000:00010000:2.0:1788586847.774050:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774056:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774063:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774069:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774073:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788586847.774077:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774085:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774092:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774100:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586847.774122:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3646:x1875469127407488:12345-0@lo:103: Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586847.774127:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788586847.774177:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127407488:0@lo:103: 00000100:00100000:2.0:1788586847.774186:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127407360:0@lo:103: 00010000:00010000:2.0:1788586847.774214:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd955a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9553 expref: 15 pid: 6515 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.774224:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127407104:0@lo:104: 00010000:00010000:2.0:1788586847.774233:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecdc00/0xfbc93bbea5fd953e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9537 expref: 14 pid: 6516 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586847.774240:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127407232:0@lo:104: 00010000:00010000:2.0:1788586847.774251:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774260:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774347:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586847.774354:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd9648 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586847.775517:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:8427:1875469127406976:0@lo:253: 10000000:01000000:1.0:1788586847.775531:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788586847.775544:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788586847.775545:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788586847.775552:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586847.775554:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586847.775555:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586847.775556:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586847.775558:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586847.775559:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586847.775560:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586847.775562:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586847.775563:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788586847.775576:0:8427:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788586847.784405:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788586847.784888:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788586847.785081:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788586847.785237:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788586847.785496:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788586847.785674:0:8427:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788586847.787354:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788586847.809219:0:8427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788586847.809230:0:8427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788586847.809702:0:8427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788586847.809752:0:8427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788586847.809775:0:8427:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788586847.809796:0:8427:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788586847.812764:0:8427:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586847.813913:0:8427:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788586848.724592:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788586848.768983:0:8512:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586848.769574:0:8512:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788586849.108654:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788586849.108674:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127407616:0@lo:41: 00000100:00100000:1.0:1788586849.109126:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586849.109252:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407616 00000100:00100000:0.0:1788586849.109261:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407616 00000100:00100000:0.0:1788586849.109309:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788586849.109319:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127407616:12345-0@lo:41: 00000004:00000024:0.0:1788586849.109355:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788586849.109493:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127407616:12345-0@lo:41: Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586849.109500:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586849.109878:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127407616:0@lo:41: 00010000:00010000:2.0:1788586849.748837:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586850.772583:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586851.798176:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788586852.692659:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788586852.692665:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5baaa5e000 from 30 10000000:01000000:2.0:1788586852.692670:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788586852.692713:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.692731:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.692742:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586852.692766:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127407744:0@lo:101: 00000100:00100000:2.0:1788586852.692834:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.692888:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad65e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586852.692930:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586852.692943:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127407872:0@lo:41: 00000100:00100000:2.0:1788586852.692972:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.693007:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407872 00000100:00100000:1.0:1788586852.693026:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407872 00000100:00100000:1.0:1788586852.693123:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788586852.693140:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127407872:12345-0@lo:41: 00000004:00000024:1.0:1788586852.693169:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788586852.693278:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127407872:12345-0@lo:41: Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586852.693346:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788586852.693392:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127407872:0@lo:41: 00000100:00100000:0.0:1788586852.693511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127407744 00000100:00100000:0.0:1788586852.693516:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127407744 00000100:00100000:0.0:1788586852.693625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788586852.693632:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127407744:12345-0@lo:101: 00010000:00010000:0.0:1788586852.693642:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586852.693654:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd964f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.693676:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.693686:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.693695:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030c00, rc 0) 00000100:00100000:0.0:1788586852.693736:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127407744:12345-0@lo:101: Request processed in 105us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.693743:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788586852.693995:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127407744:0@lo:101: 00010000:00010000:1.0:1788586852.694009:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.694019:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586852.694088:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408000:0@lo:501: 00000100:00100000:1.0:1788586852.694116:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.694143:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586852.694193:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408000 00000100:00100000:3.0:1788586852.694198:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408000 00000100:00100000:3.0:1788586852.694268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788586852.694276:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127408000:12345-0@lo:501: 00000100:00100000:3.0:1788586852.694398:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127408000:12345-0@lo:501: Request processed in 123us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.694432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788586852.694491:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408000:0@lo:501: 00000100:00100000:1.0:1788586852.694912:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408128:0@lo:503: 00000100:00100000:1.0:1788586852.694950:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.695031:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.695065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408128 00000100:00100000:0.0:1788586852.695076:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408128 00000100:00100000:0.0:1788586852.695096:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586852.695102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127408128:12345-0@lo:503: 00000100:00100000:0.0:1788586852.695225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127408128:12345-0@lo:503: Request processed in 122us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.695232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788586852.695324:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408128:0@lo:503: 00000100:00100000:0.0:1788586852.696222:0:8735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8735:1875469127408256:0@lo:502: 00000100:00100000:0.0:1788586852.696268:0:8735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.696301:0:8735:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586852.696352:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408256 00000100:00100000:1.0:1788586852.696358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408256 00000100:00100000:1.0:1788586852.696394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788586852.696402:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8735:x1875469127408256:12345-0@lo:502: 00000100:00100000:1.0:1788586852.696704:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8735:x1875469127408256:12345-0@lo:502: Request processed in 301us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586852.696711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788586852.696797:0:8735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8735:1875469127408256:0@lo:502: 00000100:00100000:0.0:1788586852.696839:0:8735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8735:1875469127408384:0@lo:502: 00000100:00100000:0.0:1788586852.696870:0:8735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.696898:0:8735:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586852.696946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408384 00000100:00100000:1.0:1788586852.696950:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408384 00000100:00100000:1.0:1788586852.696978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788586852.696985:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8735:x1875469127408384:12345-0@lo:502: 00000100:00100000:1.0:1788586852.697044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:8735:x1875469127408384:12345-0@lo:502: Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586852.697051:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788586852.697132:0:8735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8735:1875469127408384:0@lo:502: 00000040:00080000:0.0:1788586852.697150:0:8735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788586852.697296:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788586852.697327:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788586852.697336:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697346:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586852.697356:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788586852.697358:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5baaa5e000 from 5 10000000:01000000:1.0:1788586852.697361:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788586852.697384:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697393:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697402:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586852.697697:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408512:0@lo:101: 00000100:00100000:0.0:1788586852.697727:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.697755:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586852.697799:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408512 00000100:00100000:1.0:1788586852.697804:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408512 00000100:00100000:1.0:1788586852.697836:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788586852.697843:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127408512:12345-0@lo:101: 00010000:00010000:1.0:1788586852.697852:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586852.697865:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd965d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697885:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697895:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697904:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318bc00, rc 0) 00000100:00100000:1.0:1788586852.697937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127408512:12345-0@lo:101: Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586852.697942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788586852.697977:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408512:0@lo:101: 00010000:00010000:1.0:1788586852.697988:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.697997:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586852.698039:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408640:0@lo:256: 00000100:00100000:1.0:1788586852.698067:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.698086:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586852.698098:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408640 00000100:00100000:1.0:1788586852.698101:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408640 00000100:00100000:1.0:1788586852.698122:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788586852.698128:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127408640:12345-0@lo:256: 20000000:01000000:1.0:1788586852.698140:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788586852.698154:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788586852.698158:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788586852.698223:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127408640:12345-0@lo:256: Request processed in 95us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586852.698230:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788586852.698259:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408640:0@lo:256: 10000000:01000000:1.0:1788586852.698298:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788586852.698303:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.698310:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586852.698318:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788586852.698320:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788586852.698322:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788586852.698335:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.698342:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.698349:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586852.698367:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408768:0@lo:101: 00000100:00100000:1.0:1788586852.698392:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.698403:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.698504:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408768 00000100:00100000:0.0:1788586852.698508:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408768 00000100:00100000:0.0:1788586852.698604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788586852.698611:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127408768:12345-0@lo:101: 00010000:00010000:0.0:1788586852.698618:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586852.698627:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd966b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.698653:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.698661:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.698667:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030600, rc 0) 00000100:00100000:0.0:1788586852.698691:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127408768:12345-0@lo:101: Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.698697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788586852.698764:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408768:0@lo:101: 00010000:00010000:1.0:1788586852.698775:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586852.698782:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586852.698828:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408896:0@lo:501: 00000100:00100000:1.0:1788586852.698850:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.698909:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.700903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127408896 00000100:00100000:0.0:1788586852.700915:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127408896 00000100:00100000:0.0:1788586852.700956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788586852.700965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127408896:12345-0@lo:501: 00000100:00100000:0.0:1788586852.701118:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127408896:12345-0@lo:501: Request processed in 154us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.701126:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788586852.701928:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127408896:0@lo:501: 00000100:00100000:1.0:1788586852.701977:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127409024:0@lo:503: 00000100:00100000:1.0:1788586852.702031:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.702099:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.702141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409024 00000100:00100000:0.0:1788586852.702146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409024 00000100:00100000:0.0:1788586852.702216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788586852.702224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127409024:12345-0@lo:503: 00000100:00100000:0.0:1788586852.702361:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127409024:12345-0@lo:503: Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.702369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788586852.702598:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127409024:0@lo:503: 00000100:00100000:1.0:1788586852.702978:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8736:1875469127409152:0@lo:502: 00000100:00100000:1.0:1788586852.703014:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.703070:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.703108:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409152 00000100:00100000:0.0:1788586852.703113:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409152 00000100:00100000:0.0:1788586852.703177:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788586852.703191:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:8736:x1875469127409152:12345-0@lo:502: 00000100:00100000:0.0:1788586852.703319:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:8736:x1875469127409152:12345-0@lo:502: Request processed in 128us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.703327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788586852.703403:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8736:1875469127409152:0@lo:502: 00000020:01000000:3.0:1788586852.703885:0:8736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788586852.703892:0:8736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788586852.703899:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586852.703901:0:8736:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788586852.703906:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788586852.703911:0:8736:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:3.0:1788586852.703933:0:8736:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788586852.703936:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788586852.703952:0:8736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f5baf190000) 00000020:00000080:3.0:1788586852.703973:0:8736:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788586852.703978:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788586852.704053:0:8736:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788586852.704059:0:8736:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788586852.704065:0:8736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fd9680 00010000:00080000:3.0:1788586852.704103:0:8736:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a81bf2000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:3.0:1788586852.704320:0:8736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788586852.716740:0:8736:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788586852.716835:0:8736:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788586852.717172:0:8736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586852.717505:0:8736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586852.717821:0:8736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788586852.717987:0:8736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788586852.721287:0:8739:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788586852.721296:0:8739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788586852.722071:0:8736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788586852.722084:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788586852.723257:0:8736:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788586852.723354:0:8736:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd9687 00000100:00080000:0.0:1788586852.723367:0:8736:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788586852.723374:0:8736:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f5a81bf2000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788586852.723434:0:8736:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a81be2300 x1875469127409280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788586852.723459:0:8736:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788586852.723620:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127409280:0@lo:8: 00000020:01000000:0.0:1788586852.723829:0:8736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586852.723836:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586852.723838:0:8736:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788586852.723842:0:8736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586852.723846:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586852.723848:0:8736:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586852.723851:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586852.723853:0:8736:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788586852.723889:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8736:1875469127409408:0@lo:502: 00000100:00100000:0.0:1788586852.723992:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.724036:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90575d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586852.724173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.724242:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409408 00000100:00100000:2.0:1788586852.724250:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409408 00000100:00100000:2.0:1788586852.724296:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788586852.724305:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:8736:x1875469127409408:12345-0@lo:502: 00000100:00100000:3.0:1788586852.724321:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127409536:0@lo:400: 00000100:00100000:3.0:1788586852.724348:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.724367:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127410048:0@lo:400: 00000100:00100000:3.0:1788586852.724388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.724463:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586852.724470:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127409664:0@lo:400: 00000100:00100000:2.0:1788586852.724472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:8736:x1875469127409408:12345-0@lo:502: Request processed in 168us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.724479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788586852.724493:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.724530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127409792:0@lo:400: 00000100:00100000:3.0:1788586852.724572:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.724593:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586852.724599:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127409920:0@lo:400: 00000100:00100000:3.0:1788586852.724621:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.724655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409536 00000100:00100000:3.0:1788586852.724659:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409536 00000100:00100000:3.0:1788586852.724680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410048 00000100:00100000:3.0:1788586852.724683:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410048 00000100:00100000:3.0:1788586852.724704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409792 00000100:00100000:3.0:1788586852.724707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409792 00000100:00100000:3.0:1788586852.724717:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409920 00000100:00100000:3.0:1788586852.724719:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409920 00000100:00100000:3.0:1788586852.724735:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586852.724740:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127409536:12345-0@lo:400: 00000100:00100000:3.0:1788586852.724789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127409536:12345-0@lo:400: Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.724795:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586852.724808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788586852.724814:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127410048:12345-0@lo:400: 00000100:00100000:3.0:1788586852.724840:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127410048:12345-0@lo:400: Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.724845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788586852.724857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586852.724862:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127409792:12345-0@lo:400: 00000100:00100000:3.0:1788586852.725059:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127409792:12345-0@lo:400: Request processed in 196us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.725066:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586852.725079:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788586852.725091:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127409920:12345-0@lo:400: 00000100:00100000:3.0:1788586852.725119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127409920:12345-0@lo:400: Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.725125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788586852.725147:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409664 00000100:00100000:3.0:1788586852.725150:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409664 00000100:00100000:3.0:1788586852.725173:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788586852.725178:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127409664:12345-0@lo:400: 00000100:00100000:3.0:1788586852.725207:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127409664:12345-0@lo:400: Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.725213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788586852.725230:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586852.725234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788586852.725258:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb4e37b80 x1875469127409920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586852.725271:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127409920:0@lo:400: 00010000:00080000:3.0:1788586852.725282:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb4e35880 x1875469127409792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586852.725290:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127409792:0@lo:400: 00000100:00100000:3.0:1788586852.725316:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127409664:0@lo:400: 00010000:00080000:3.0:1788586852.725326:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb4e34e00 x1875469127409536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586852.725334:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127409536:0@lo:400: 00010000:00080000:3.0:1788586852.725343:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb4e35f80 x1875469127410048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586852.725361:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127410048:0@lo:400: 00000100:00100000:3.0:1788586852.725638:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8736:1875469127409408:0@lo:502: 00000020:01000000:3.0:1788586852.725665:0:8736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586852.725670:0:8736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586852.725673:0:8736:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788586852.725676:0:8736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1788586852.725733:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788586852.726070:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788586852.726079:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.726090:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586852.726100:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586852.726103:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5b86e73000 from 30 10000000:01000000:3.0:1788586852.726106:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586852.726131:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.726139:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.726147:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586852.726162:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127410176:0@lo:101: 00000100:00100000:3.0:1788586852.726197:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.726231:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.726728:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127409280 00000100:00100000:0.0:1788586852.726735:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127409280 00000100:00100000:0.0:1788586852.726866:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586852.726889:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875469127409280:12345-0@lo:8: 00010000:00080000:0.0:1788586852.726921:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1788586852.726946:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd9695 00002000:00100000:0.0:1788586852.726984:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f5a81bcd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788586852.726988:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788586852.726991:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788586852.727049:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788586852.727308:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788586852.727333:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bcc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586852.727397:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875469127409280:12345-0@lo:8: Request processed in 517us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.727404:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586852.728018:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410176 00000100:00100000:0.0:1788586852.728025:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410176 00000100:00100000:0.0:1788586852.728092:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788586852.728101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127410176:12345-0@lo:101: 00010000:00010000:0.0:1788586852.728111:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586852.728128:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd968e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.728154:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.728165:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.728174:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030400, rc 0) 00000100:00100000:0.0:1788586852.728213:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127410176:12345-0@lo:101: Request processed in 114us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.728226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788586852.728501:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81be2300 x1875469127409280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788586862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586852.728511:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788586852.728620:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788586852.728628:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788586852.728698:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788586852.728702:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bf2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788586852.728723:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788586852.728729:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127409280:0@lo:8: 00000100:00100000:3.0:1788586852.728849:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127410304:0@lo:700: 00000100:00100000:3.0:1788586852.728883:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.729012:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127410176:0@lo:101: 00010000:00010000:0.0:1788586852.729027:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.729037:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586852.729091:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127410432:0@lo:501: 00000100:00100000:3.0:1788586852.733398:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410304 00000100:00100000:3.0:1788586852.733454:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410304 00000100:00100000:3.0:1788586852.733512:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586852.733535:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8740:x1875469127410304:12345-0@lo:700: 00000100:00100000:3.0:1788586852.733588:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1875469127410560:0@lo:700: 00000100:00100000:0.0:1788586852.735050:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.735104:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e6f6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788586852.735136:0:8739:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788586852.735221:0:8739:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 198665804806ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788586852.735229:0:8739:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788586852.735363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410432 00000100:00100000:2.0:1788586852.735371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410432 00000100:00100000:2.0:1788586852.735449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788586852.735466:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127410432:12345-0@lo:501: 00000100:00100000:2.0:1788586852.735671:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127410432:12345-0@lo:501: Request processed in 206us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.735678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788586852.736070:0:8442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.736093:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2900 going to sleep for 11 seconds 00000100:00080000:3.0:1788586852.736110:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586852.736148:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410560 00000100:00100000:3.0:1788586852.736153:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410560 00000100:00100000:3.0:1788586852.736184:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586852.736189:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1875469127410560:12345-0@lo:700: 00000100:00100000:2.0:1788586852.737183:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127410432:0@lo:501: 00000100:00100000:2.0:1788586852.737640:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127410688:0@lo:503: 00000100:00100000:2.0:1788586852.737713:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.737743:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad65e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.737814:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410688 00000100:00100000:0.0:1788586852.737821:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410688 00000100:00100000:0.0:1788586852.737869:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788586852.737876:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127410688:12345-0@lo:503: 00000100:00100000:0.0:1788586852.737998:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127410688:12345-0@lo:503: Request processed in 121us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.738006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788586852.738319:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127410688:0@lo:503: 00000100:00100000:2.0:1788586852.738472:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2240 going to sleep for 11 seconds 00000004:00080000:2.0:1788586852.739699:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788586852.739850:0:8741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8741:1875469127410816:0@lo:502: 00000100:00100000:2.0:1788586852.739916:0:8741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.739951:0:8741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad65ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.740003:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410816 00000100:00100000:0.0:1788586852.740009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410816 00000100:00100000:0.0:1788586852.740061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788586852.740070:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8741:x1875469127410816:12345-0@lo:502: 00000100:00100000:0.0:1788586852.740173:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8741:x1875469127410816:12345-0@lo:502: Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.740180:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788586852.740318:0:8741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8741:1875469127410816:0@lo:502: 00000100:00100000:2.0:1788586852.740363:0:8741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8741:1875469127410944:0@lo:502: 00000100:00100000:2.0:1788586852.740395:0:8741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.740446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127410944 00000100:00100000:2.0:1788586852.740450:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127410944 00000100:00100000:2.0:1788586852.741058:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788586852.741068:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8741:x1875469127410944:12345-0@lo:502: 00000100:00100000:2.0:1788586852.741153:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:8741:x1875469127410944:12345-0@lo:502: Request processed in 86us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.741160:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788586852.741203:0:8741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb05ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586852.742634:0:8741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8741:1875469127410944:0@lo:502: 00000040:00080000:2.0:1788586852.742669:0:8741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788586852.742823:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788586852.742850:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586852.742860:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.742872:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586852.743359:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788586852.743362:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5b86e73000 from 5 10000000:01000000:3.0:1788586852.743365:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788586852.743398:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.743444:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.743454:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586852.743474:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411072:0@lo:101: 00000100:00100000:3.0:1788586852.743591:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.743625:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586852.744336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411072 00000100:00100000:2.0:1788586852.744345:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411072 00000100:00100000:2.0:1788586852.744391:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788586852.744400:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127411072:12345-0@lo:101: 00010000:00010000:2.0:1788586852.744435:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586852.744451:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd96a3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.744473:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.744484:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.744492:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7000, rc 0) 00000100:00100000:2.0:1788586852.745649:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127411072:12345-0@lo:101: Request processed in 1246us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.745658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788586852.746508:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411072:0@lo:101: 00010000:00010000:3.0:1788586852.746544:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.746556:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586852.746620:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411200:0@lo:256: 00000100:00100000:3.0:1788586852.746679:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.746710:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586852.746726:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411200 00000100:00100000:3.0:1788586852.746732:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411200 00000100:00100000:3.0:1788586852.746997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788586852.747007:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127411200:12345-0@lo:256: 20000000:01000000:3.0:1788586852.747025:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788586852.747039:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788586852.747042:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788586852.747117:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127411200:12345-0@lo:256: Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.747129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788586852.747163:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411200:0@lo:256: 10000000:01000000:3.0:1788586852.747203:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788586852.747210:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747219:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586852.747229:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788586852.747231:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788586852.747234:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586852.747255:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747263:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747272:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586852.747284:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411328:0@lo:101: 00000100:00100000:3.0:1788586852.747380:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.747397:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586852.747446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411328 00000100:00100000:3.0:1788586852.747450:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411328 00000100:00100000:3.0:1788586852.747472:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788586852.747478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127411328:12345-0@lo:101: 00010000:00010000:3.0:1788586852.747494:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586852.747505:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd96b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747535:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747545:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747552:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd200, rc 0) 00000100:00100000:3.0:1788586852.747595:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127411328:12345-0@lo:101: Request processed in 117us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.747601:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788586852.747632:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411328:0@lo:101: 00010000:00010000:3.0:1788586852.747822:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.747830:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586852.747880:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411456:0@lo:501: 00000100:00100000:3.0:1788586852.747977:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.748003:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586852.748035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411456 00000100:00100000:2.0:1788586852.748040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411456 00000100:00100000:2.0:1788586852.748073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788586852.748079:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127411456:12345-0@lo:501: 00000100:00100000:2.0:1788586852.748189:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127411456:12345-0@lo:501: Request processed in 109us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.748195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788586852.748224:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411456:0@lo:501: 00000100:00100000:3.0:1788586852.748252:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411584:0@lo:503: 00000100:00100000:3.0:1788586852.748355:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.748381:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 40000000:02000000:3.0:1788586852.749362:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788586852.749463:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411584 00000100:00100000:2.0:1788586852.749476:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411584 00000100:00100000:2.0:1788586852.749615:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788586852.749624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127411584:12345-0@lo:503: 00000100:00100000:2.0:1788586852.749731:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127411584:12345-0@lo:503: Request processed in 108us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.749738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788586852.760007:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1875469127410560:12345-0@lo:700: Request processed in 23809us (23929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.760022:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586852.760101:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127411584:0@lo:503: 00010000:00080000:0.0:1788586852.760328:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81091c00 x1875469127410560/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586852.760342:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1875469127410560:0@lo:700: 40000000:02000000:0.0:1788586852.760351:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:3.0:1788586852.769154:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:2.0:1788586852.769472:0:8740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81090700 x1875469127410304/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586852.769490:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127410304:0@lo:700: 00000100:00100000:0.0:1788586852.769492:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8740:x1875469127410304:12345-0@lo:700: Request processed in 35959us (40607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.769505:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586852.769824:0:8742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8742:1875469127411712:0@lo:502: 00000100:00100000:0.0:1788586852.769871:0:8742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.769980:0:8742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586852.770016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411712 00000100:00100000:2.0:1788586852.770022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411712 00000100:00100000:0.0:1788586852.771084:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788586852.771099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:8742:x1875469127411712:12345-0@lo:502: 00000100:00100000:0.0:1788586852.771245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:8742:x1875469127411712:12345-0@lo:502: Request processed in 151us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.771253:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788586852.771316:0:8742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8742:1875469127411712:0@lo:502: 00000020:01000000:0.0:1788586852.771346:0:8742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788586852.771354:0:8742:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788586852.771362:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586852.771364:0:8742:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788586852.771369:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788586852.771372:0:8742:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:0.0:1788586852.771394:0:8742:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788586852.771398:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788586852.771445:0:8742:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f5a826eb380) 00000020:00000080:0.0:1788586852.771466:0:8742:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788586852.771473:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788586852.771589:0:8742:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788586852.771594:0:8742:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788586852.771601:0:8742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd96c6 00010000:00080000:0.0:1788586852.771627:0:8742:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bbc9ba800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788586852.771859:0:8742:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1788586852.778843:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:3.0:1788586852.778875:0:8740:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788586852.779033:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127411968:0@lo:7: 00000100:00100000:3.0:1788586852.779095:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.779141:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.779187:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127411840:0@lo:13: 00000100:00100000:0.0:1788586852.779218:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.779256:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411840 00000100:00100000:0.0:1788586852.779263:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411840 00000100:00100000:2.0:1788586852.779382:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127411968 00000100:00100000:2.0:1788586852.779387:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127411968 00000100:00100000:2.0:1788586852.779441:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586852.779441:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586852.779451:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8740:x1875469127411968:12345-0@lo:7: 00000100:00100000:0.0:1788586852.779451:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875469127411840:12345-0@lo:13: 00002000:00000024:0.0:1788586852.779475:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788586852.779518:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875469127411840:12345-0@lo:13: Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.779525:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788586852.779614:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81092d80 x1875469127411840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586852.779699:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127411840:0@lo:13: 00000040:01000000:0.0:1788586852.787143:0:8742:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788586852.787168:0:8742:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788586852.787496:0:8742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586852.787870:0:8742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586852.788160:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788586852.788263:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00002000:00080000:2.0:1788586852.788981:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788586852.788988:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788586852.789154:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8740:x1875469127411968:12345-0@lo:7: Request processed in 9701us (10056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.789230:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788586852.789357:0:8740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81093100 x1875469127411968/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586852.789373:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127411968:0@lo:7: 00000004:00080000:2.0:1788586852.789386:0:8740:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788586852.789466:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127412096:0@lo:5: 00000100:00100000:2.0:1788586852.789502:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.789541:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb05eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.789563:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412096 00000100:00100000:0.0:1788586852.789571:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412096 00000100:00100000:0.0:1788586852.789616:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586852.789625:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8740:x1875469127412096:12345-0@lo:5: 00002000:00080000:0.0:1788586852.789660:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788586852.789696:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8740:x1875469127412096:12345-0@lo:5: Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.789703:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788586852.789732:0:8740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa4a80 x1875469127412096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586852.789742:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127412096:0@lo:5: 00000004:00080000:2.0:1788586852.789752:0:8740:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788586852.789787:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127412224:0@lo:5: 00000100:00100000:2.0:1788586852.789811:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.789837:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb05eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.789892:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412224 00000100:00100000:0.0:1788586852.789896:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412224 00000100:00100000:0.0:1788586852.789924:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586852.789931:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8740:x1875469127412224:12345-0@lo:5: 00002000:00080000:0.0:1788586852.789952:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000040:00080000:3.0:1788586852.791552:0:8743:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586852.791559:0:8743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788586852.793199:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8740:x1875469127412224:12345-0@lo:5: Request processed in 3263us (3382us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788586852.793212:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:3.0:1788586852.793348:0:8742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788586852.793360:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788586852.793396:0:8742:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788586852.793456:0:8742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd96cd 00000100:00080000:3.0:1788586852.793465:0:8742:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788586852.793470:0:8742:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f5bbc9ba800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788586852.793503:0:8742:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a81093480 x1875469127412352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788586852.793520:0:8742:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788586852.793610:0:8742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788586852.793612:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127412352:0@lo:8: 00000020:00000080:3.0:1788586852.793617:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586852.793620:0:8742:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788586852.793623:0:8742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586852.793628:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586852.793630:0:8742:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000100:00100000:0.0:1788586852.793671:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586852.793718:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412352 00000100:00100000:0.0:1788586852.793724:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412352 00000100:00100000:0.0:1788586852.793756:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586852.793762:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875469127412352:12345-0@lo:8: 00010000:00080000:0.0:1788586852.793787:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1788586852.793811:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586852.793813:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd96d4 00000020:00000080:3.0:1788586852.793814:0:8742:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00002000:00100000:0.0:1788586852.793830:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f5ba7eb1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788586852.793836:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788586852.793840:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788586852.793842:0:8742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8742:1875469127412480:0@lo:502: 00000100:00100000:3.0:1788586852.793891:0:8742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788586852.793893:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788586852.793918:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5ba7eb3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586852.793960:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875469127412352:12345-0@lo:8: Request processed in 196us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.793967:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788586852.793980:0:8742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2600 going to sleep for 11 seconds 00010000:00080000:0.0:1788586852.794011:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81093480 x1875469127412352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788586862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586852.794021:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788586852.794029:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788586852.794036:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788586852.794041:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788586852.794043:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc9ba800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1788586852.794085:0:8740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa4a80 x1875469127412224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586852.794098:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8740:1875469127412224:0@lo:5: 00000004:00080000:2.0:1788586852.794108:0:8740:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788586852.794132:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8740:1875469127412608:0@lo:900: 00000100:00100000:2.0:1788586852.794169:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.794187:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb05eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788586852.794201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412480 00000100:00100000:2.0:1788586852.794204:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412480 00000100:00100000:2.0:1788586852.794234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788586852.794241:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:8742:x1875469127412480:12345-0@lo:502: 00000100:00100000:2.0:1788586852.794432:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:8742:x1875469127412480:12345-0@lo:502: Request processed in 164us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586852.794440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788586852.794724:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412608 00000100:00100000:3.0:1788586852.794729:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412608 00000100:00100000:3.0:1788586852.794828:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586852.794835:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8740:x1875469127412608:12345-0@lo:900: 00000100:00100000:3.0:1788586852.794878:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8740:x1875469127412608:12345-0@lo:900: Request processed in 44us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.794885:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586852.794985:0:8742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:8742:1875469127412480:0@lo:502: 00000020:01000000:3.0:1788586852.795011:0:8742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586852.795016:0:8742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586852.795018:0:8742:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788586852.795022:0:8742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788586852.795236:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788586852.795257:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788586852.795266:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.795282:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586852.795524:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788586852.795527:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f5bb05e3380 from 1 10000000:01000000:2.0:1788586852.795529:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788586852.795555:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.795564:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.795573:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586852.795587:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127412736:0@lo:101: 00000100:00100000:2.0:1788586852.795621:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788586852.796465:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788586852.796486:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127412352:0@lo:8: 00000100:00100000:2.0:1788586852.796578:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4c7fe40 going to sleep for 11 seconds 00010000:00080000:2.0:1788586852.796610:0:8740:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa7100 x1875469127412608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586852.796621:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8740:1875469127412608:0@lo:900: 00000100:00100000:1.0:1788586852.800561:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127412864:0@lo:13: 00000100:00100000:1.0:1788586852.800699:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.800837:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412864 00000100:00100000:1.0:1788586852.800845:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412864 00000100:00100000:1.0:1788586852.800982:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586852.801001:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127412864:12345-0@lo:13: 00002000:00000024:1.0:1788586852.801023:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788586852.801071:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127412864:12345-0@lo:13: Request processed in 73us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586852.801078:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788586852.801097:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788586852.801124:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb05adf80 x1875469127412864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586852.801143:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127412864:0@lo:13: 00000004:00080000:1.0:1788586852.801163:0:8744:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788586852.801183:0:8744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127412992:0@lo:7: 00000100:00100000:1.0:1788586852.801207:0:8744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.801223:0:8744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586852.801460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412736 00000100:00100000:3.0:1788586852.801466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412736 00000100:00100000:3.0:1788586852.801497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788586852.801503:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127412736:12345-0@lo:101: 00010000:00010000:3.0:1788586852.801514:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586852.801532:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd96db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.801556:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.801568:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586852.801584:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd800, rc 0) 00000100:00100000:3.0:1788586852.801621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127412736:12345-0@lo:101: Request processed in 118us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.801627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788586852.802732:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127412992 00000100:00100000:0.0:1788586852.802744:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127412992 00000100:00100000:0.0:1788586852.802788:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586852.802795:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8744:x1875469127412992:12345-0@lo:7: 00000004:00080000:3.0:1788586852.803881:0:8743:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788586852.803963:0:8743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 198734546475ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788586852.803971:0:8743:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788586852.804242:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127412736:0@lo:101: 00010000:00010000:2.0:1788586852.804265:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586852.804277:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586852.804361:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127413120:0@lo:501: 00000100:00100000:2.0:1788586852.804725:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586852.804886:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4c7fe40 going to sleep for 11 seconds 00000004:00080000:3.0:1788586852.805836:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788586852.811456:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788586852.811472:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788586852.811565:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8744:x1875469127412992:12345-0@lo:7: Request processed in 8766us (10352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586852.811575:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586852.811620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413120 00000100:00100000:0.0:1788586852.811628:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413120 00000100:00100000:0.0:1788586852.811674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788586852.811683:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127413120:12345-0@lo:501: 00010000:00080000:3.0:1788586852.811788:0:8744:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb05adf80 x1875469127412992/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586852.811791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127413120:12345-0@lo:501: Request processed in 107us (7065us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586852.811808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788586852.811814:0:8744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127412992:0@lo:7: 00000004:00080000:3.0:1788586852.811831:0:8744:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788586852.811857:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127413120:0@lo:501: 00000100:00100000:3.0:1788586852.811871:0:8744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127413248:0@lo:5: 10000000:01000000:0.0:1788586852.811895:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788586852.811906:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586852.811916:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586852.812018:0:8744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586852.812048:0:8744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.812127:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413248 00000100:00100000:0.0:1788586852.812132:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413248 00000100:00100000:0.0:1788586852.812351:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586852.812361:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8744:x1875469127413248:12345-0@lo:5: 00002000:00080000:0.0:1788586852.812380:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788586852.812384:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00010000:3.0:1788586852.820982:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788586852.821115:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:2.0:1788586852.821129:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788586852.821133:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788586852.821395:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8744:x1875469127413248:12345-0@lo:5: Request processed in 9032us (9373us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788586852.821440:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788586852.821530:0:8744:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81090380 x1875469127413248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586852.821547:0:8744:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788586852.821552:0:8744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127413248:0@lo:5: 00000004:00080000:1.0:1788586852.821567:0:8744:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788586852.821616:0:8744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127413376:0@lo:700: 00000100:00100000:1.0:1788586852.821661:0:8744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.821688:0:8744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586852.821862:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413376 00000100:00100000:3.0:1788586852.821868:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413376 00000100:00100000:3.0:1788586852.821921:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586852.821930:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8744:x1875469127413376:12345-0@lo:700: 00000100:00100000:3.0:1788586852.835216:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8744:x1875469127413376:12345-0@lo:700: Request processed in 13268us (13536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586852.835232:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788586852.836048:0:8744:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb05af800 x1875469127413376/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586852.836066:0:8744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127413376:0@lo:700: 00000004:02000040:0.0:1788586852.845253:0:8744:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788586852.856050:0:8744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127413504:0@lo:5: 00000100:00100000:1.0:1788586852.856128:0:8744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586852.856230:0:8744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586852.856342:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413504 00000100:00100000:0.0:1788586852.856350:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413504 00000100:00100000:0.0:1788586852.856493:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586852.856503:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8744:x1875469127413504:12345-0@lo:5: 00002000:00080000:0.0:1788586852.863125:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788586852.863149:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788586852.866879:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8744:x1875469127413504:12345-0@lo:5: Request processed in 10370us (10744us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788586852.866892:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788586852.866994:0:8744:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb05af800 x1875469127413504/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586852.867013:0:8744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8744:1875469127413504:0@lo:5: 00000004:00080000:1.0:1788586852.867029:0:8744:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788586853.851441:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788586854.041300:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788586854.228940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127413632:0@lo:41: 00000100:00100000:1.0:1788586854.229017:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586854.229098:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413632 00000100:00100000:1.0:1788586854.229105:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413632 00000100:00100000:1.0:1788586854.229150:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788586854.229159:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127413632:12345-0@lo:41: 00000004:00000024:1.0:1788586854.229201:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788586854.229245:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127413632:12345-0@lo:41: Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586854.229252:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788586854.229295:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127413632:0@lo:41: 00000020:00000004:0.0:1788586854.865551:0:8862:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586854.865792:0:8862:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788586854.868956:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788586855.596255:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788586855.894342:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586856.921035:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788586857.503677:0:8964:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586857.503882:0:8964:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788586857.812672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127414016:0@lo:400: 00000100:00100000:3.0:1788586857.812745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.812805:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127414528:0@lo:400: 00000100:00100000:3.0:1788586857.812830:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.812855:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788586857.812861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127414144:0@lo:400: 00000100:00100000:3.0:1788586857.812895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.812913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127414656:0@lo:400: 00000100:00100000:0.0:1788586857.812935:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127413760:0@lo:400: 00000100:00100000:3.0:1788586857.812938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586857.812983:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.812987:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414016 00000100:00100000:3.0:1788586857.812995:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414016 00000100:00100000:0.0:1788586857.813016:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127414272:0@lo:400: 00000100:00100000:0.0:1788586857.813045:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.813049:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586857.813060:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127414016:12345-0@lo:400: 00000100:00100000:0.0:1788586857.813069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127414784:0@lo:400: 00000100:00100000:0.0:1788586857.813096:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586857.813123:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788586857.813130:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127414016:12345-0@lo:400: Request processed in 70us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586857.813132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127413888:0@lo:400: 00000100:00100000:3.0:1788586857.813145:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586857.813162:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414272 00000100:00100000:3.0:1788586857.813168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414272 00000100:00100000:0.0:1788586857.813168:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.813191:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788586857.813193:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127414400:0@lo:400: 00000100:00100000:3.0:1788586857.813201:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127414272:12345-0@lo:400: 00000100:00100000:0.0:1788586857.813223:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.813247:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127414272:12345-0@lo:400: Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.813255:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788586857.813260:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127414272:0@lo:400: 00000100:00100000:3.0:1788586857.813275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414528 00000100:00100000:3.0:1788586857.813279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414528 00000100:00100000:0.0:1788586857.813298:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414656 00000100:00100000:0.0:1788586857.813303:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414656 00000100:00100000:3.0:1788586857.813314:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414144 00000100:00100000:3.0:1788586857.813319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414144 00000100:00100000:0.0:1788586857.813338:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414784 00000100:00100000:3.0:1788586857.813341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413888 00000100:00100000:0.0:1788586857.813343:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414784 00000100:00100000:3.0:1788586857.813361:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413888 00000100:00100000:3.0:1788586857.813397:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414400 00000100:00100000:3.0:1788586857.813401:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414400 00000100:00100000:0.0:1788586857.813406:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586857.813451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586857.813453:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127414656:12345-0@lo:400: 00000100:00100000:3.0:1788586857.813463:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127414528:12345-0@lo:400: 00000100:00100000:0.0:1788586857.813514:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127414656:12345-0@lo:400: Request processed in 99us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.813516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127414528:12345-0@lo:400: Request processed in 57us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586857.813532:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586857.813533:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788586857.813554:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788586857.813560:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586857.813564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127414144:12345-0@lo:400: 00000100:00100000:0.0:1788586857.813574:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127414784:12345-0@lo:400: 00000100:00100000:3.0:1788586857.813596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127414144:12345-0@lo:400: Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.813602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788586857.813613:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788586857.813619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127413888:12345-0@lo:400: 00000100:00100000:0.0:1788586857.813631:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127414784:12345-0@lo:400: Request processed in 60us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586857.813639:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586857.813651:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127413888:12345-0@lo:400: Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.813657:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788586857.813671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788586857.813677:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127414400:12345-0@lo:400: 00000100:00100000:3.0:1788586857.813716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127414400:12345-0@lo:400: Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.813722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788586857.813745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127413760 00000100:00100000:3.0:1788586857.813748:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127413760 00000100:00100000:3.0:1788586857.813770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788586857.813776:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3646:x1875469127413760:12345-0@lo:400: 00000100:00100000:3.0:1788586857.813809:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3646:x1875469127413760:12345-0@lo:400: Request processed in 33us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.813815:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788586857.813844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586857.813849:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586857.813851:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788586857.813874:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81092300 x1875469127414144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586857.813886:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127414144:0@lo:400: 00010000:00080000:3.0:1788586857.813897:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81093100 x1875469127414656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586857.813904:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788586857.813925:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127414656:0@lo:400: 00000100:00100000:3.0:1788586857.813936:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127414016:0@lo:400: 00010000:00080000:3.0:1788586857.813945:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81093480 x1875469127414528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586857.813953:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127414528:0@lo:400: 00010000:00080000:0.0:1788586857.814096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81091500 x1875469127413888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586857.814108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127413888:0@lo:400: 00010000:00080000:0.0:1788586857.814123:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81090380 x1875469127414400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586857.814131:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127414400:0@lo:400: 00000100:00100000:0.0:1788586857.814141:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127413760:0@lo:400: 00010000:00080000:0.0:1788586857.814149:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81092d80 x1875469127414784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586857.814155:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788586857.814166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127414784:0@lo:400: 00000100:00100000:0.0:1788586857.814181:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586857.814188:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127414912:0@lo:13: 00000100:00100000:0.0:1788586857.814214:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.814319:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127414912 00000100:00100000:3.0:1788586857.814324:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127414912 00000100:00100000:3.0:1788586857.814361:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586857.814368:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127414912:12345-0@lo:13: 00002000:00000024:3.0:1788586857.814399:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586857.814677:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127414912:12345-0@lo:13: Request processed in 307us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.814684:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586857.814895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127415168:0@lo:41: 00000100:00100000:3.0:1788586857.814923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586857.814955:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586857.814963:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127415040:0@lo:13: 00000100:00100000:0.0:1788586857.814971:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415168 00000100:00100000:0.0:1788586857.814977:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415168 00000100:00100000:3.0:1788586857.814988:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586857.815011:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586857.815020:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415040 00000100:00100000:0.0:1788586857.815021:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127415168:12345-0@lo:41: 00000100:00100000:3.0:1788586857.815026:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415040 00000004:00000024:0.0:1788586857.815048:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788586857.815056:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586857.815064:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127415040:12345-0@lo:13: 00002000:00000024:3.0:1788586857.815078:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586857.815093:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127415168:12345-0@lo:41: Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586857.815101:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586857.815116:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127415040:12345-0@lo:13: Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586857.815124:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788586857.815160:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81be2680 x1875469127415040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586857.815175:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127415040:0@lo:13: 00000100:00100000:3.0:1788586857.815186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127415168:0@lo:41: 00010000:00080000:2.0:1788586857.816945:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a82297b80 x1875469127414912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586857.816969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127414912:0@lo:13: 00010000:00010000:3.0:1788586857.941864:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788586858.306339:0:9012:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788586858.306349:0:9012:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788586858.964620:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586859.348616:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586859.348643:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127415296:0@lo:41: 00000100:00100000:3.0:1788586859.348713:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586859.348894:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415296 00000100:00100000:1.0:1788586859.348902:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415296 00000100:00100000:1.0:1788586859.348951:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788586859.348960:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127415296:12345-0@lo:41: 00000004:00000024:1.0:1788586859.349019:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788586859.349072:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127415296:12345-0@lo:41: Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586859.349079:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586859.349461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127415296:0@lo:41: 00010000:00010000:0.0:1788586859.988658:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586861.015026:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586862.046879:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586862.935569:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127415424:0@lo:41: 00000100:00100000:3.0:1788586862.935641:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935696:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127415936:0@lo:400: 00000100:00100000:3.0:1788586862.935731:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935749:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127416448:0@lo:400: 00000100:00100000:3.0:1788586862.935770:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935799:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788586862.935804:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127415808:0@lo:400: 00000100:00100000:3.0:1788586862.935822:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935837:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127416320:0@lo:400: 00000100:00100000:3.0:1788586862.935853:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127415552:0@lo:400: 00000100:00100000:3.0:1788586862.935898:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935916:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127416064:0@lo:400: 00000100:00100000:3.0:1788586862.935933:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127416576:0@lo:400: 00000100:00100000:3.0:1788586862.935963:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.935977:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788586862.935981:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127415680:0@lo:400: 00000100:00100000:3.0:1788586862.935996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.936007:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127416192:0@lo:400: 00000100:00100000:3.0:1788586862.936024:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.936046:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415936 00000100:00100000:3.0:1788586862.936054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415936 00000100:00100000:3.0:1788586862.936091:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416320 00000100:00100000:3.0:1788586862.936094:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416320 00000100:00100000:3.0:1788586862.936116:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415680 00000100:00100000:3.0:1788586862.936119:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415680 00000100:00100000:3.0:1788586862.936127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416192 00000100:00100000:3.0:1788586862.936129:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416192 00000100:00100000:3.0:1788586862.936154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788586862.936161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127415936:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936211:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127415936:12345-0@lo:400: Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936218:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788586862.936233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586862.936239:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127416320:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936263:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127416320:12345-0@lo:400: Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586862.936279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586862.936283:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127415680:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127415680:12345-0@lo:400: Request processed in 23us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586862.936320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586862.936326:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127416192:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127416192:12345-0@lo:400: Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936365:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586862.936382:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415424 00000100:00100000:3.0:1788586862.936385:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415424 00000100:00100000:3.0:1788586862.936399:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415808 00000100:00100000:3.0:1788586862.936402:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415808 00000100:00100000:3.0:1788586862.936409:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416064 00000100:00100000:3.0:1788586862.936411:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416064 00000100:00100000:3.0:1788586862.936442:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586862.936448:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127415424:12345-0@lo:41: 00000004:00000024:3.0:1788586862.936478:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788586862.936510:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127415424:12345-0@lo:41: Request processed in 62us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936516:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586862.936525:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788586862.936530:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127415808:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936549:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127415808:12345-0@lo:400: Request processed in 20us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936554:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788586862.936561:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586862.936565:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127416064:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936585:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127416064:12345-0@lo:400: Request processed in 20us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936589:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586862.936606:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416448 00000100:00100000:3.0:1788586862.936609:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416448 00000100:00100000:3.0:1788586862.936629:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416576 00000100:00100000:3.0:1788586862.936631:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416576 00000100:00100000:3.0:1788586862.936642:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586862.936647:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127416448:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936672:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127416448:12345-0@lo:400: Request processed in 25us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936678:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586862.936687:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586862.936692:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127416576:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936716:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127416576:12345-0@lo:400: Request processed in 24us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936727:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586862.936748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127415808:0@lo:400: 00010000:00080000:3.0:1788586862.936750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf4a80 x1875469127415680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788586862.936759:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf5500 x1875469127416320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586862.936761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127415680:0@lo:400: 00000100:00100000:2.0:1788586862.936769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127416320:0@lo:400: 00010000:00080000:3.0:1788586862.936770:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf6a00 x1875469127416192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586862.936778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127416192:0@lo:400: 00000100:00100000:2.0:1788586862.936781:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127415424:0@lo:41: 00000100:00100000:3.0:1788586862.936785:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127416064:0@lo:400: 00010000:00080000:2.0:1788586862.936789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf4380 x1875469127415936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788586862.936793:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf6300 x1875469127416576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586862.936797:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127415936:0@lo:400: 00000100:00100000:3.0:1788586862.936801:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127416576:0@lo:400: 00010000:00080000:2.0:1788586862.936805:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf5f80 x1875469127416448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586862.936818:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127416448:0@lo:400: 00000100:00080000:3.0:1788586862.936833:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586862.936838:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586862.936839:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586862.936866:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127415552 00000100:00100000:3.0:1788586862.936869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127415552 00000100:00100000:3.0:1788586862.936906:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788586862.936912:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3648:x1875469127415552:12345-0@lo:400: 00000100:00100000:3.0:1788586862.936948:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3648:x1875469127415552:12345-0@lo:400: Request processed in 36us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.936954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788586862.937050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127415552:0@lo:400: 00000100:00100000:3.0:1788586862.939298:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127416704:0@lo:13: 00000100:00100000:3.0:1788586862.939375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.939473:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416704 00000100:00100000:3.0:1788586862.939481:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416704 00000100:00100000:3.0:1788586862.939526:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788586862.939534:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127416704:12345-0@lo:13: 00002000:00000024:3.0:1788586862.939579:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586862.939619:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127416704:12345-0@lo:13: Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.939626:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788586862.939665:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb07100 x1875469127416704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586862.939689:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127416704:0@lo:13: 00000100:00100000:0.0:1788586862.943017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127416832:0@lo:13: 00000100:00100000:0.0:1788586862.943091:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586862.943175:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416832 00000100:00100000:3.0:1788586862.943184:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416832 00000100:00100000:3.0:1788586862.943236:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586862.943246:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127416832:12345-0@lo:13: 00002000:00000024:3.0:1788586862.943267:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586862.943313:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127416832:12345-0@lo:13: Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586862.943320:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788586862.943408:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcaf6300 x1875469127416832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586862.943463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127416832:0@lo:13: 00010000:00010000:2.0:1788586863.060529:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586864.087512:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586864.469180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127416960:0@lo:41: 00000100:00100000:0.0:1788586864.469249:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586864.470190:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127416960 00000100:00100000:0.0:1788586864.470200:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127416960 00000100:00100000:0.0:1788586864.471649:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586864.471670:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127416960:12345-0@lo:41: 00000004:00000024:0.0:1788586864.471713:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788586864.471785:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127416960:12345-0@lo:41: Request processed in 123us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586864.471969:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586864.472208:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127416960:0@lo:41: 00010000:00010000:2.0:1788586865.108716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586866.132993:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788586867.023352:0:9511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788586867.023356:0:9511:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788586867.023357:0:9511:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788586867.023536:0:9511:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f5bbcb3b800 00000020:01000004:2.0:1788586867.023553:0:9511:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788586867.023568:0:9511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788586867.023582:0:9511:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f5a82433380) 00000020:00000080:2.0:1788586867.023598:0:9511:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788586867.070918:0:9511:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788586867.070979:0:9511:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788586867.088480:0:9511:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788586867.088724:0:9511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788586867.088749:0:9511:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788586867.088762:0:9511:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfbc93bbea5fd96f0 00000020:01000004:2.0:1788586867.088770:0:9511:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788586867.088794:0:9511:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788586867.088799:0:9511:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788586867.088804:0:9511:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788586867.088833:0:9511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788586867.088838:0:9511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788586867.124645:0:9511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788586867.124691:0:9511:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.101@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788586867.124696:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788586867.124698:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788586867.124699:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586867.124700:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586867.124702:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586867.124703:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586867.124704:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586867.124705:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586867.124707:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586867.124709:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586867.124710:0:9511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788586867.124714:0:9511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788586867.124717:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788586867.124718:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788586867.124719:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586867.124720:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586867.124722:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586867.124723:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586867.124724:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586867.124725:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586867.124726:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586867.124727:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586867.124728:0:9511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788586867.124758:0:9511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788586867.124789:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127417088:0@lo:253: 00000100:00100000:0.0:1788586867.124868:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.124921:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaad600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586867.124926:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417088 00000100:00100000:3.0:1788586867.124935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417088 00000100:00100000:3.0:1788586867.124993:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788586867.125004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:9511:x1875469127417088:12345-0@lo:253: 20000000:01000000:3.0:1788586867.125034:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788586867.125038:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788586867.125043:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788586867.125046:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788586867.125256:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788586867.125402:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788586867.125449:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788586867.125471:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788586867.125478:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788586867.125506:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788586867.125522:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788586867.125604:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788586867.125620:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.101@tcp 20000000:01000000:3.0:1788586867.125622:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788586867.125635:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788586867.125640:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788586867.125652:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788586867.125658:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:3.0:1788586867.125669:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788586867.125675:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788586867.125685:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788586867.125701:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788586867.125780:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788586867.125792:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.101@tcp 20000000:01000000:3.0:1788586867.125794:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788586867.125808:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788586867.125815:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788586867.125828:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788586867.125833:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:3.0:1788586867.125845:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788586867.125850:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788586867.125861:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788586867.125875:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788586867.126228:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788586867.126239:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.101@tcp 20000000:01000000:3.0:1788586867.126241:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.101@tcp (null) (null) (null) 00000040:00080000:3.0:1788586867.126266:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788586867.126272:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788586867.126298:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788586867.126304:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.101@tcp (null) (null) 00000040:00080000:3.0:1788586867.126332:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788586867.126338:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788586867.126352:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788586867.126367:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788586867.126380:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788586867.126383:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788586867.126387:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788586867.126456:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788586867.126459:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788586867.133049:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788586867.133098:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788586867.133118:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788586867.133300:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788586867.133338:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788586867.133356:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788586867.133371:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788586867.133374:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788586867.135669:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788586867.135723:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788586867.135742:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788586867.135910:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788586867.135936:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788586867.135952:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788586867.135962:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788586867.135964:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788586867.137021:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788586867.137073:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788586867.137088:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788586867.137257:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788586867.137282:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788586867.137300:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788586867.137323:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788586867.137325:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788586867.137814:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788586867.137847:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788586867.137863:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788586867.138060:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788586867.138081:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788586867.138099:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788586867.138108:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788586867.138110:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788586867.138575:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788586867.138700:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788586867.138722:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788586867.138763:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:3.0:1788586867.138794:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788586867.138814:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138832:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138839:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138846:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138853:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138861:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138867:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138874:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138882:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138920:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.138945:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 21 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.138960:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417216:0@lo:104: 00000100:00100000:3.0:1788586867.139037:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586867.139090:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139100:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 21 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.139109:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417344:0@lo:104: 00000100:00100000:3.0:1788586867.139131:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586867.139158:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139167:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 21 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.139176:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417472:0@lo:104: 00000100:00100000:2.0:1788586867.139192:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417216 00000100:00100000:3.0:1788586867.139200:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.139201:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417216 00010000:00010000:3.0:1788586867.139228:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139239:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 21 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.139239:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417344 00000100:00100000:2.0:1788586867.139244:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417344 00000100:00100000:3.0:1788586867.139254:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417600:0@lo:104: 00000100:00100000:2.0:1788586867.139258:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417472 00000100:00100000:2.0:1788586867.139269:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417472 00000100:00100000:2.0:1788586867.139295:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788586867.139296:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.139321:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6514:x1875469127417216:12345-0@lo:104: 00010000:00010000:2.0:1788586867.139335:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139344:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139355:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 21 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.139364:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417728:0@lo:104: 00000100:00100000:3.0:1788586867.139394:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586867.139395:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586867.139404:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6514:x1875469127417216:12345-0@lo:104: Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.139412:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788586867.139437:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139448:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 21 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.139449:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417600 00000100:00100000:2.0:1788586867.139454:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417600 00000100:00100000:3.0:1788586867.139461:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417856:0@lo:104: 00000100:00100000:2.0:1788586867.139471:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417728 00000100:00100000:2.0:1788586867.139476:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417728 00000100:00100000:3.0:1788586867.139490:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.139494:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788586867.139502:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6514:x1875469127417344:12345-0@lo:104: 00010000:00010000:2.0:1788586867.139511:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139512:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.139533:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 21 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.139543:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417984:0@lo:104: 00010000:00010000:2.0:1788586867.139562:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586867.139567:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcab9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.139569:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6514:x1875469127417344:12345-0@lo:104: Request processed in 68us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.139578:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788586867.139591:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417216:0@lo:104: 00000100:00100000:2.0:1788586867.139598:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788586867.139603:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417344:0@lo:104: 00000100:00100000:2.0:1788586867.139617:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.139628:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417856 00000100:00100000:2.0:1788586867.139631:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417856 00000100:00100000:2.0:1788586867.139645:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127417984 00000100:00100000:2.0:1788586867.139647:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127417984 00000100:00100000:2.0:1788586867.139686:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788586867.139839:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788586867.139846:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139854:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586867.139858:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139867:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586867.139875:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586867.139882:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586867.139925:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139932:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586867.139947:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139965:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd96db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139976:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586867.139980:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139987:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586867.139990:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.139998:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586867.140004:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586867.140010:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788586867.140011:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418112:0@lo:103: 00010000:00010000:1.0:1788586867.140044:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.140052:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788586867.140056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586867.140070:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.140078:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc800/0xfbc93bbea5fd96b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.140090:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586867.140091:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788586867.140099:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586867.140100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418240:0@lo:103: 00010000:00010000:1.0:1788586867.140103:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586867.140126:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586867.140168:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418112 00000100:00100000:3.0:1788586867.140172:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418112 00010000:00010000:3.0:1788586867.140204:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 22 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.140226:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418240 00000100:00100000:3.0:1788586867.140230:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418240 00000100:00100000:2.0:1788586867.140240:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+7:6514:x1875469127417472:12345-0@lo:104: 00010000:00010000:3.0:1788586867.140245:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 23 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.140250:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.140267:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788586867.140276:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3648:x1875469127418112:12345-0@lo:103: 00010000:00010000:3.0:1788586867.140287:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586867.140293:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 23 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.140295:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586867.140305:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+7:6514:x1875469127417472:12345-0@lo:104: Request processed in 68us (1104us total) trans 0 rc 0/0 00010000:00010000:3.0:1788586867.140321:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 23 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.140368:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586867.140376:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3648:x1875469127418240:12345-0@lo:103: 00010000:00010000:1.0:1788586867.140384:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586867.140388:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 23 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.140831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586867.140852:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788586867.140859:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6514:x1875469127417600:12345-0@lo:104: 00010000:00010000:2.0:1788586867.140868:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.140899:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788586867.140904:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:6514:x1875469127417600:12345-0@lo:104: Request processed in 47us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.140910:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788586867.140922:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586867.140927:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6514:x1875469127417728:12345-0@lo:104: 00010000:00010000:2.0:1788586867.140935:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.140960:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788586867.140965:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:6514:x1875469127417728:12345-0@lo:104: Request processed in 38us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.140970:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586867.140982:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586867.140995:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6514:x1875469127417856:12345-0@lo:104: 00010000:00010000:2.0:1788586867.141003:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141031:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788586867.141036:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:6514:x1875469127417856:12345-0@lo:104: Request processed in 43us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.141041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586867.141102:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788586867.141109:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6514:x1875469127417984:12345-0@lo:104: 00010000:00010000:2.0:1788586867.141116:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141141:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788586867.141146:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6514:x1875469127417984:12345-0@lo:104: Request processed in 39us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.141152:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788586867.141169:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788586867.141174:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141181:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecdc00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586867.141184:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141192:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586867.141198:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586867.141209:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586867.141227:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141232:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586867.141255:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141261:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd968e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd969c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141272:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788586867.141275:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141280:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318a200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586867.141282:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141288:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586867.141293:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586867.141298:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586867.141321:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141327:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586867.141339:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141346:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd966b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9672 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141357:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788586867.141359:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141365:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586867.141368:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141374:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586867.141380:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586867.141386:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586867.141398:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141403:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586867.141433:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141440:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd964f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9656 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141449:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586867.141457:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141463:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318ae00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586867.141465:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141472:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586867.141477:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586867.141481:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586867.141496:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141501:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586867.141506:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141511:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9617 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141520:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586867.141523:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141529:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586867.141532:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141561:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586867.141567:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586867.141572:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586867.141584:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141590:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586867.141594:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141600:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd95e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95ed expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.141613:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586867.141615:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586867.141617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586867.144146:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 23 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.144173:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd96b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd96b1 expref: 23 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.144195:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586867.144267:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3648:x1875469127418240:12345-0@lo:103: Request processed in 3890us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.144276:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788586867.144327:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586867.144562:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127418368:0@lo:103: 00000100:00100000:0.0:1788586867.144607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.144655:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127418880:0@lo:103: 00000100:00100000:0.0:1788586867.144678:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.144712:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586867.144718:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127418496:0@lo:103: 00000100:00100000:0.0:1788586867.144739:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.144851:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418368 00000100:00100000:2.0:1788586867.144859:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418368 00010000:00010000:2.0:1788586867.144888:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 22 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.144906:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd96e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd96db expref: 22 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.144907:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418880 00000100:00100000:2.0:1788586867.144911:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418880 00010000:00010000:2.0:1788586867.144922:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 22 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.144923:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.144935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418496 00000100:00100000:2.0:1788586867.144949:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418496 00000100:00100000:3.0:1788586867.144960:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3648:x1875469127418112:12345-0@lo:103: Request processed in 4684us (4905us total) trans 0 rc 0/0 00010000:00010000:2.0:1788586867.144962:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 23 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586867.144975:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788586867.146159:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586867.146174:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3646:x1875469127418368:12345-0@lo:103: 00010000:00010000:2.0:1788586867.146190:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586867.146198:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 22 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.146210:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 22 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.146224:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.146280:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3646:x1875469127418368:12345-0@lo:103: Request processed in 111us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.146287:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586867.146303:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788586867.146325:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3646:x1875469127418880:12345-0@lo:103: 00010000:00010000:2.0:1788586867.146334:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586867.146338:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 21 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.146345:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 21 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.146354:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.146375:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3646:x1875469127418880:12345-0@lo:103: Request processed in 67us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.146381:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788586867.146458:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586867.146465:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3646:x1875469127418496:12345-0@lo:103: 00010000:00010000:2.0:1788586867.146472:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586867.146477:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 20 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.146485:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 20 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.146495:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.146516:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3646:x1875469127418496:12345-0@lo:103: Request processed in 52us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.146522:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586867.147605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418624:0@lo:103: 00000100:00100000:2.0:1788586867.147668:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.147892:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418240:0@lo:103: 00000100:00100000:2.0:1788586867.147903:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418112:0@lo:103: 00000100:00100000:2.0:1788586867.147928:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586867.147935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418752:0@lo:103: 00000100:00100000:2.0:1788586867.147958:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.147983:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418624 00000100:00100000:2.0:1788586867.147989:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418624 00010000:00010000:2.0:1788586867.148018:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 20 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148132:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127418752 00000100:00100000:2.0:1788586867.148136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127418752 00010000:00010000:2.0:1788586867.148151:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 21 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148179:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586867.148187:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3648:x1875469127418624:12345-0@lo:103: 00010000:00010000:2.0:1788586867.148199:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586867.148204:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 21 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148215:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 21 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148231:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.148264:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3648:x1875469127418624:12345-0@lo:103: Request processed in 78us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.148271:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586867.148286:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788586867.148292:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3648:x1875469127418752:12345-0@lo:103: 00010000:00010000:2.0:1788586867.148299:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586867.148304:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 20 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148327:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 20 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148340:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148349:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148373:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148380:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148387:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148394:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148401:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecde00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788586867.148405:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148413:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148444:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.148454:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.148479:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3648:x1875469127418752:12345-0@lo:103: Request processed in 187us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.148486:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788586867.148512:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418752:0@lo:103: 00000100:00100000:2.0:1788586867.148520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127418624:0@lo:103: 00010000:00010000:2.0:1788586867.148550:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd969c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd968e expref: 19 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148571:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417472:0@lo:104: 00010000:00010000:2.0:1788586867.148587:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030600/0xfbc93bbea5fd9672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd966b expref: 18 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148595:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417600:0@lo:104: 00010000:00010000:2.0:1788586867.148606:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd9656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd964f expref: 17 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148613:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417728:0@lo:104: 00010000:00010000:2.0:1788586867.148622:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd9617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9610 expref: 16 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148630:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417856:0@lo:104: 00010000:00010000:2.0:1788586867.148641:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd95ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd95e6 expref: 15 pid: 6516 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.148649:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1875469127417984:0@lo:104: 00010000:00010000:2.0:1788586867.149025:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.149035:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.149041:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.149048:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd96f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788586867.149146:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788586867.151221:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127418496:0@lo:103: 00000100:00100000:0.0:1788586867.151242:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127418368:0@lo:103: 00000100:00100000:0.0:1788586867.151251:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127418880:0@lo:103: 00000100:00100000:2.0:1788586867.153959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:9511:x1875469127417088:12345-0@lo:253: Request processed in 28949us (29082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.153975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788586867.153987:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127417088:0@lo:253: 10000000:01000000:0.0:1788586867.154231:0:9511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788586867.154234:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788586867.154236:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788586867.154237:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586867.154238:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788586867.154240:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586867.154241:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586867.154242:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586867.154244:0:9511:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788586867.154245:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586867.154246:0:9511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788586867.154269:0:9511:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5bbcb3b800 from lustre-OST0001 10000000:01000000:0.0:1788586867.154303:0:9511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788586867.154306:0:9511:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788586867.154330:0:9511:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f5bb05e3380 local copy 10000000:01000000:0.0:1788586867.154334:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788586867.154380:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586867.154391:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586867.154402:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586867.154534:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419008:0@lo:101: 00000100:00100000:0.0:1788586867.154577:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.154613:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.154706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419008 00000100:00100000:2.0:1788586867.154713:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419008 00000100:00100000:2.0:1788586867.154762:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788586867.154773:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:9511:x1875469127419008:12345-0@lo:101: 00010000:00010000:2.0:1788586867.154786:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586867.154800:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd96fe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.154828:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96fe expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.154838:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96fe expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.154847:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6400, rc 0) 00000100:00100000:2.0:1788586867.154892:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419008:12345-0@lo:101: Request processed in 120us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.154898:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788586867.155096:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419008:0@lo:101: 00010000:00010000:1.0:1788586867.155111:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.155121:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.155215:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419136:0@lo:501: 00000100:00100000:1.0:1788586867.155243:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.155264:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.155283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419136 00000100:00100000:2.0:1788586867.155288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419136 00000100:00100000:2.0:1788586867.155328:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788586867.155336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419136:12345-0@lo:501: 00000100:00100000:2.0:1788586867.155505:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419136:12345-0@lo:501: Request processed in 169us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788586867.155518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788586867.155997:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419136:0@lo:501: 10000000:01000000:1.0:1788586867.156013:0:9511:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788586867.156033:0:9511:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788586867.156040:0:9511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.156048:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.156056:0:9511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.156334:0:9511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788586867.156371:0:9511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5bbcb3b800 10000000:01000000:1.0:1788586867.156376:0:9511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788586867.156382:0:9511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788586867.156384:0:9511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586867.156389:0:9511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788586867.156392:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788586867.156439:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.156448:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.156457:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.156475:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419264:0@lo:101: 00000100:00100000:1.0:1788586867.156512:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.156549:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78180 going to sleep for 11 seconds 00000100:00100000:3.0:1788586867.156652:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419264 00000100:00100000:3.0:1788586867.156658:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419264 00000100:00100000:3.0:1788586867.156732:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788586867.156741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419264:12345-0@lo:101: 00010000:00010000:3.0:1788586867.156750:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586867.156763:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd970c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.156783:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.156793:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.156800:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd800, rc 0) 00000100:00100000:3.0:1788586867.156842:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127419264:12345-0@lo:101: Request processed in 102us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586867.156849:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788586867.157135:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419264:0@lo:101: 00010000:00010000:1.0:1788586867.157149:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.157160:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.157228:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419392:0@lo:501: 00000100:00100000:1.0:1788586867.157257:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586867.158125:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586867.158135:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.158143:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031a00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788586867.158147:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.158157:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586867.158164:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586867.158170:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586867.158196:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.158203:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586867.158226:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.158234:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd96fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xfbc93bbea5fd9705 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.158250:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586867.158252:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586867.158254:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586867.158586:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127419520:0@lo:103: 00000100:00100000:2.0:1788586867.158650:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.158926:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419520 00000100:00100000:2.0:1788586867.158939:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419520 00000100:00100000:2.0:1788586867.158999:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586867.159008:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3647:x1875469127419520:12345-0@lo:103: 00010000:00010000:2.0:1788586867.159157:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586867.159173:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd96fe expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.159185:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586867.159219:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3647:x1875469127419520:12345-0@lo:103: Request processed in 212us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.159226:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586867.159256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127419520:0@lo:103: 00000100:00100000:0.0:1788586867.159386:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419392 00000100:00100000:0.0:1788586867.159392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419392 00000100:00100000:1.0:1788586867.159408:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78180 going to sleep for 11 seconds 00010000:00010000:1.0:1788586867.159467:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586867.159567:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788586867.159577:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419392:12345-0@lo:501: 00000100:00100000:0.0:1788586867.159753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419392:12345-0@lo:501: Request processed in 178us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.159760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788586867.159825:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419392:0@lo:501: 00000100:00100000:1.0:1788586867.159862:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419648:0@lo:503: 00000100:00100000:1.0:1788586867.159906:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.159934:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78180 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.160000:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419648 00000100:00100000:2.0:1788586867.160005:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419648 00000100:00100000:2.0:1788586867.160038:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788586867.160045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419648:12345-0@lo:503: 00000100:00100000:2.0:1788586867.160143:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419648:12345-0@lo:503: Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.160150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788586867.160180:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419648:0@lo:503: 00000040:00080000:1.0:1788586867.160596:0:9511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788586867.160659:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419776:0@lo:502: 00000100:00100000:1.0:1788586867.160695:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.160795:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78180 going to sleep for 11 seconds 00000100:00100000:0.0:1788586867.160900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419776 00000100:00100000:0.0:1788586867.160905:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419776 00000100:00100000:0.0:1788586867.160965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788586867.160972:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419776:12345-0@lo:502: 00000100:00100000:0.0:1788586867.161140:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419776:12345-0@lo:502: Request processed in 167us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.161147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788586867.161207:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419776:0@lo:502: 00000040:00080000:1.0:1788586867.161408:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788586867.161456:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788586867.161470:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788586867.161483:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788586867.161495:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788586867.161516:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788586867.161537:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419904:0@lo:502: 00000100:00100000:1.0:1788586867.161569:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.161707:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78180 going to sleep for 11 seconds 00000100:00100000:3.0:1788586867.161751:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127419904 00000100:00100000:3.0:1788586867.161755:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127419904 00000100:00100000:2.0:1788586867.161814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788586867.161822:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419904:12345-0@lo:502: 00000100:00100000:2.0:1788586867.161911:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127419904:12345-0@lo:502: Request processed in 89us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.161918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788586867.161951:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127419904:0@lo:502: 00000040:00080000:1.0:1788586867.161989:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788586867.162101:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788586867.164681:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788586867.164701:0:9522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788586867.164708:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586867.164711:0:9522:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788586867.164718:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586867.164734:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f5bb4c999c0) 00000020:00000080:1.0:1788586867.164759:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788586867.164765:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788586867.164851:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bbcb3b800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788586867.164861:0:9522:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788586867.164869:0:9522:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfbc93bbea5fd9721 00010000:00010000:2.0:1788586867.181494:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788586867.183002:0:9522:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788586867.198549:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788586867.198978:0:9522:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788586867.209126:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788586867.209277:0:9522:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788586867.221861:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788586867.233256:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788586867.233269:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586867.233275:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586867.233283:0:9522:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788586867.233287:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586867.233292:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586867.233293:0:9522:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586867.233297:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586867.233299:0:9522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788586867.233337:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586867.233341:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586867.233342:0:9522:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788586867.233346:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788586867.235454:0:9511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788586867.235497:0:9511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788586867.235519:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.235532:0:9511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586867.235540:0:9511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bbcb3b800 from 1 10000000:01000000:1.0:1788586867.235543:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788586867.235578:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.235599:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.235609:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.235634:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420032:0@lo:101: 00000100:00100000:1.0:1788586867.235708:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.235749:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586867.239871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420032 00000100:00100000:3.0:1788586867.239887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420032 00000100:00100000:3.0:1788586867.239951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788586867.239962:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:9511:x1875469127420032:12345-0@lo:101: 00010000:00010000:3.0:1788586867.239990:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586867.240021:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9728 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.240054:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.240067:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.240076:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecce00, rc 0) 00000100:00100000:3.0:1788586867.240148:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420032:12345-0@lo:101: Request processed in 188us (4441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586867.240155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788586867.242083:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420032:0@lo:101: 00010000:00010000:1.0:1788586867.242107:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.242120:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.242225:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420160:0@lo:501: 00000100:00100000:1.0:1788586867.242271:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.242320:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78600 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.242476:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420160 00000100:00100000:2.0:1788586867.242483:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420160 00000100:00100000:2.0:1788586867.242523:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788586867.242532:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420160:12345-0@lo:501: 00000100:00100000:2.0:1788586867.242643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420160:12345-0@lo:501: Request processed in 112us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.242651:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788586867.246299:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420160:0@lo:501: 00000100:00100000:1.0:1788586867.246375:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420288:0@lo:503: 00000100:00100000:1.0:1788586867.246482:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.246520:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78600 going to sleep for 11 seconds 00000100:00100000:0.0:1788586867.247115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420288 00000100:00100000:0.0:1788586867.247123:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420288 00000100:00100000:0.0:1788586867.247173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788586867.247183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420288:12345-0@lo:503: 00000100:00100000:0.0:1788586867.247317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420288:12345-0@lo:503: Request processed in 125us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.247325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788586867.247458:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420288:0@lo:503: 00000040:00080000:3.0:1788586867.247738:0:9511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788586867.247832:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420416:0@lo:502: 00000100:00100000:3.0:1788586867.247877:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586867.247907:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788586867.248535:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420416 00000100:00100000:0.0:1788586867.248542:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420416 00000100:00100000:0.0:1788586867.248581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788586867.248594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420416:12345-0@lo:502: 00000100:00100000:0.0:1788586867.248896:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420416:12345-0@lo:502: Request processed in 302us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.248903:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788586867.251113:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420416:0@lo:502: 00000040:00080000:1.0:1788586867.251503:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788586867.251532:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788586867.251564:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420544:0@lo:502: 00000100:00100000:1.0:1788586867.251627:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.251674:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78900 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.251886:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420544 00000100:00100000:2.0:1788586867.251892:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420544 00000100:00100000:2.0:1788586867.251940:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788586867.251949:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420544:12345-0@lo:502: 00000100:00100000:2.0:1788586867.252047:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420544:12345-0@lo:502: Request processed in 99us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.252055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788586867.252235:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420544:0@lo:502: 00000040:00080000:1.0:1788586867.252276:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788586867.252284:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788586867.253651:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586867.253674:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586867.253677:0:9526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788586867.253683:0:9526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5bbcb3b800 00000020:00000080:2.0:1788586867.253686:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788586867.253814:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586867.253818:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586867.253819:0:9526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788586867.253822:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788586867.254565:0:9511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788586867.254612:0:9511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586867.254633:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.254645:0:9511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586867.254872:0:9511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788586867.254876:0:9511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5bbcb3b800 10000000:01000000:1.0:1788586867.254880:0:9511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5bbcb3b800 10000000:01000000:1.0:1788586867.254884:0:9511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586867.254889:0:9511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5bbcb3b800 from 1 10000000:01000000:1.0:1788586867.254892:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586867.254929:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.254938:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.254949:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.254974:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420672:0@lo:101: 00000100:00100000:1.0:1788586867.255038:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.255126:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586867.259079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420672 00000100:00100000:3.0:1788586867.259096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420672 00000100:00100000:3.0:1788586867.259208:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788586867.259218:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:9511:x1875469127420672:12345-0@lo:101: 00010000:00010000:3.0:1788586867.259235:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586867.259252:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9736 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.259279:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.259325:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.259334:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecc200, rc 0) 00000100:00100000:3.0:1788586867.259441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127420672:12345-0@lo:101: Request processed in 225us (4403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586867.259449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788586867.259539:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420672:0@lo:101: 00010000:00010000:1.0:1788586867.259559:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.259568:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.259688:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420800:0@lo:501: 00000100:00100000:1.0:1788586867.259733:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.264106:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.268401:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420800 00000100:00100000:2.0:1788586867.268439:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420800 00000100:00100000:1.0:1788586867.269896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788586867.269910:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127420800:12345-0@lo:501: 00000100:00100000:1.0:1788586867.270084:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127420800:12345-0@lo:501: Request processed in 176us (10349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.270092:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788586867.270547:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420800:0@lo:501: 00000100:00100000:2.0:1788586867.270608:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420928:0@lo:503: 00000100:00100000:2.0:1788586867.270668:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.270702:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb14cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586867.271233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127420928 00000100:00100000:1.0:1788586867.271240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127420928 00000100:00100000:1.0:1788586867.271270:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788586867.271277:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127420928:12345-0@lo:503: 00000100:00100000:1.0:1788586867.271442:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127420928:12345-0@lo:503: Request processed in 136us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.271450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788586867.271920:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127420928:0@lo:503: 00000040:00080000:2.0:1788586867.272155:0:9511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788586867.272226:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127421056:0@lo:502: 00000100:00100000:2.0:1788586867.272272:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586867.272298:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb14cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586867.272376:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421056 00000100:00100000:1.0:1788586867.272381:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421056 00000100:00100000:1.0:1788586867.272444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788586867.272452:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127421056:12345-0@lo:502: 00000100:00100000:1.0:1788586867.272545:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127421056:12345-0@lo:502: Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.272553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788586867.273109:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127421056:0@lo:502: 00000040:00080000:2.0:1788586867.273290:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788586867.273329:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788586867.273346:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788586867.273373:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788586867.273391:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788586867.273405:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788586867.273459:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788586867.273477:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788586867.273494:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788586867.273509:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788586867.273523:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788586867.273538:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788586867.273552:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788586867.273568:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788586867.273582:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788586867.273596:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788586867.273609:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788586867.273622:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788586867.273636:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788586867.273650:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788586867.273853:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788586867.273868:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788586867.273882:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788586867.273899:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788586867.273913:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788586867.273927:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788586867.273942:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788586867.273959:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788586867.274039:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788586867.274066:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788586867.274083:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788586867.274097:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788586867.274118:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788586867.274132:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788586867.274145:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788586867.274171:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788586867.274185:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788586867.274197:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788586867.274211:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788586867.274225:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788586867.274319:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788586867.274339:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788586867.274362:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788586867.274375:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788586867.274387:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788586867.274401:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1788586867.274625:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127421184:0@lo:502: 00000100:00100000:1.0:1788586867.274771:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.274817:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78180 going to sleep for 11 seconds 00000100:00100000:2.0:1788586867.275601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421184 00000100:00100000:2.0:1788586867.275611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421184 00000100:00100000:2.0:1788586867.275651:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788586867.275660:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127421184:12345-0@lo:502: 00000100:00100000:2.0:1788586867.275807:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127421184:12345-0@lo:502: Request processed in 148us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.275815:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788586867.276054:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127421184:0@lo:502: 00000040:00080000:1.0:1788586867.276134:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788586867.276145:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788586867.279939:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788586867.279975:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f5a83343380) 00000020:00000080:1.0:1788586867.280000:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788586867.280103:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bbcb3b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788586867.280108:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bbcb3b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788586867.280111:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bbcb3b800 3 00010000:00080000:1.0:1788586867.280139:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a83355000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788586867.282411:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788586867.282635:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788586867.282680:0:9527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586867.282693:0:9527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfbc93bbea5fd974b 00000100:00080000:1.0:1788586867.282704:0:9527:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586867.282710:0:9527:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f5a83355000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586867.282745:0:9527:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bbcb05500 x1875469127421312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586867.282774:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788586867.282891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127421440:0@lo:400: 00000100:00100000:1.0:1788586867.282958:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283000:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127421952:0@lo:400: 00000100:00100000:1.0:1788586867.283022:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283043:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788586867.283048:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127421568:0@lo:400: 00000100:00100000:1.0:1788586867.283074:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283091:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127422080:0@lo:400: 00000100:00100000:1.0:1788586867.283130:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127421824:0@lo:400: 00000100:00100000:1.0:1788586867.283191:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283209:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127422336:0@lo:400: 00000100:00100000:1.0:1788586867.283236:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283256:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788586867.283261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127421696:0@lo:400: 00000100:00100000:1.0:1788586867.283284:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.283295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127422208:0@lo:400: 00000100:00100000:0.0:1788586867.283558:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421568 00000100:00100000:0.0:1788586867.283578:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421568 00000100:00100000:0.0:1788586867.283625:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421824 00000100:00100000:0.0:1788586867.283628:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421824 00000100:00100000:0.0:1788586867.283646:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788586867.283654:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127421568:12345-0@lo:400: 00000100:00100000:0.0:1788586867.283708:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127421568:12345-0@lo:400: Request processed in 55us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.283715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788586867.283730:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586867.283736:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127421824:12345-0@lo:400: 00000100:00100000:0.0:1788586867.283762:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127421824:12345-0@lo:400: Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.283769:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586867.283785:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421440 00000100:00100000:0.0:1788586867.283789:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421440 00000100:00100000:0.0:1788586867.283808:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421952 00000100:00100000:0.0:1788586867.283810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421952 00000100:00100000:0.0:1788586867.283833:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422080 00000100:00100000:0.0:1788586867.283842:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422080 00000100:00100000:0.0:1788586867.283858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421696 00000100:00100000:0.0:1788586867.283860:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421696 00000100:00100000:0.0:1788586867.283875:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788586867.283881:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127421440:12345-0@lo:400: 00000100:00100000:0.0:1788586867.283911:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127421440:12345-0@lo:400: Request processed in 31us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.283917:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788586867.283927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788586867.283933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127421952:12345-0@lo:400: 00000100:00100000:0.0:1788586867.283958:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127421952:12345-0@lo:400: Request processed in 26us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.283963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788586867.283973:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788586867.283978:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127422080:12345-0@lo:400: 00000100:00100000:0.0:1788586867.284002:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127422080:12345-0@lo:400: Request processed in 25us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.284007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788586867.284017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788586867.284023:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127421696:12345-0@lo:400: 00000100:00100000:0.0:1788586867.284052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127421696:12345-0@lo:400: Request processed in 30us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.284058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788586867.284091:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788586867.284095:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:0.0:1788586867.284278:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788586867.284292:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f5a826e8000) 00000020:00000080:0.0:1788586867.284328:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788586867.284438:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bbcb3b800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788586867.284442:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bbcb3b800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788586867.284445:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bbcb3b800 3 00010000:00080000:0.0:1788586867.284472:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bad6cd800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.101@tcp at head 00000100:00100000:2.0:1788586867.286003:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127421312:0@lo:38: 00000100:00100000:2.0:1788586867.286070:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.286099:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127421312 00000100:00100000:0.0:1788586867.286108:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127421312 00000100:00100000:0.0:1788586867.286150:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586867.287744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127421312:12345-0@lo:38: 00010000:00080000:0.0:1788586867.287777:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788586867.287811:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfbc93bbea5fd9759 00000004:00100000:0.0:1788586867.287828:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788586867.287858:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6ce800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586867.287933:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875469127421312:12345-0@lo:38: Request processed in 1775us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.288265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586867.288325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127421824:0@lo:400: 00010000:00080000:1.0:1788586867.288351:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb05180 x1875469127421696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.288362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127421696:0@lo:400: 00000100:00100000:1.0:1788586867.288407:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422336 00000100:00100000:1.0:1788586867.288413:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422336 00000100:00100000:1.0:1788586867.288494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422208 00000100:00100000:1.0:1788586867.288498:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422208 00000100:00100000:1.0:1788586867.288515:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586867.288522:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127422336:12345-0@lo:400: 00000100:00100000:1.0:1788586867.288573:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127422336:12345-0@lo:400: Request processed in 50us (5337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.288580:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586867.288596:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586867.288602:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127422208:12345-0@lo:400: 00000100:00100000:1.0:1788586867.288627:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127422208:12345-0@lo:400: Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.288632:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788586867.288653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586867.288676:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127421568:0@lo:400: 00010000:00080000:1.0:1788586867.288896:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb07b80 x1875469127422080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.288906:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127422080:0@lo:400: 00010000:00080000:1.0:1788586867.288919:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb05f80 x1875469127421440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.288926:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127421440:0@lo:400: 00010000:00080000:1.0:1788586867.288937:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb04e00 x1875469127421952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.288945:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127421952:0@lo:400: 00010000:00080000:1.0:1788586867.288989:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb04700 x1875469127422208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.288998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127422208:0@lo:400: 00010000:00080000:1.0:1788586867.289008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb05880 x1875469127422336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.289023:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127422336:0@lo:400: 00010000:00010000:1.0:1788586867.289606:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788586867.290658:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788586867.290806:0:9527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586867.290817:0:9527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xfbc93bbea5fd9760 00000100:00080000:1.0:1788586867.290826:0:9527:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586867.290832:0:9527:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f5bad6cd800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788586867.290863:0:9527:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bbcb05880 x1875469127422464/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586867.290877:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788586867.290964:0:9528:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8f5bbcb04700 x1875469127422592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586867.290973:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78b40 going to sleep for 0 seconds 00000100:00100000:0.0:1788586867.291354:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788586867.291516:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb05500 x1875469127421312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586867.291527:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586867.291535:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788586867.291541:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788586867.291545:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788586867.291548:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788586867.291555:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002399a411): req@ffff8f5bbcb04700 x1875469127422592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:1.0:1788586867.291763:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788586867.293727:0:9511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788586867.293771:0:9511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586867.293789:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.293801:0:9511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788586867.293875:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788586867.293877:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788586867.293878:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586867.293880:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586867.293881:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586867.293883:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586867.293884:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788586867.293886:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586867.293888:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586867.293889:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586867.293890:0:9511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788586867.293895:0:9511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788586867.293897:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788586867.293898:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788586867.293899:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586867.293900:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586867.293901:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586867.293910:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586867.293911:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788586867.293912:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586867.293912:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586867.293913:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586867.293914:0:9511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788586867.293938:0:9511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788586867.293955:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127422720:0@lo:253: 00000100:00100000:3.0:1788586867.294024:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586867.294065:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586867.295532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422720 00000100:00100000:0.0:1788586867.295542:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422720 00000100:00100000:0.0:1788586867.295634:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788586867.295644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127422720:12345-0@lo:253: 20000000:01000000:0.0:1788586867.295683:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788586867.295704:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788586867.295860:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.295895:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422592 00000100:00100000:0.0:1788586867.295899:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422592 00000100:00100000:0.0:1788586867.295939:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586867.295947:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1875469127422592:12345-0@lo:901: 00000100:00100000:0.0:1788586867.296022:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1875469127422592:12345-0@lo:901: Request processed in 76us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.296037:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788586867.296060:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788586867.296091:0:9528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb04700 x1875469127422592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788586883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586867.296104:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9528:1875469127422592:0@lo:901: 00000100:00100000:2.0:1788586867.296572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127421312:0@lo:38: 00000100:00100000:2.0:1788586867.296595:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875469127422464:0@lo:38: 00000100:00100000:2.0:1788586867.296638:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.297082:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422464 00000100:00100000:0.0:1788586867.297089:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422464 00000100:00100000:0.0:1788586867.297123:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788586867.297129:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127422464:12345-0@lo:38: 00010000:00080000:0.0:1788586867.297154:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788586867.297200:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xfbc93bbea5fd9767 00000004:00100000:0.0:1788586867.297214:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788586867.297246:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6cf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586867.297295:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875469127422464:12345-0@lo:38: Request processed in 164us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.297303:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788586867.297351:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb05880 x1875469127422464/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586867.297372:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788586867.297379:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788586867.297386:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788586867.297390:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788586867.297393:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6cd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788586867.297398:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875469127422464:0@lo:38: 20000000:01000000:3.0:1788586867.304846:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788586867.305102:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788586867.307093:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:9511:x1875469127422720:12345-0@lo:253: Request processed in 11443us (13061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586867.307105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788586867.307245:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:47977fce-e1b1-4b0c-879f-0e023b1316c2:9511:1875469127422720:0@lo:253: 10000000:01000000:0.0:1788586867.307271:0:9511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788586867.307274:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788586867.307276:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788586867.307277:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586867.307278:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586867.307279:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586867.307281:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586867.307282:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586867.307283:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586867.307285:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586867.307286:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586867.307287:0:9511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788586867.307299:0:9511:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788586867.308605:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788586867.308612:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788586867.312787:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.312812:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.312819:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.312825:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.312865:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.312891:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 16 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.312905:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127422848:0@lo:104: 00000100:00100000:2.0:1788586867.312969:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586867.313031:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422848 00000100:00100000:3.0:1788586867.313040:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422848 00010000:00010000:2.0:1788586867.313044:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.313054:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 16 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.313062:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127422976:0@lo:104: 00000100:00100000:3.0:1788586867.313095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586867.313105:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127422848:12345-0@lo:104: 00010000:00010000:3.0:1788586867.313119:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.313155:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586867.313177:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586867.313184:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127422848:12345-0@lo:104: Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586867.313186:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb14a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586867.313195:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586867.313213:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127422976 00000100:00100000:2.0:1788586867.313213:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127422848:0@lo:104: 00000100:00100000:3.0:1788586867.313218:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127422976 00000100:00100000:3.0:1788586867.313238:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586867.313245:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82295500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127422976:12345-0@lo:104: 00010000:00010000:3.0:1788586867.313254:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313317:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586867.313323:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82295500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:6536:x1875469127422976:12345-0@lo:104: Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586867.313330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788586867.313355:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586867.313362:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.313368:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1875469127422976:0@lo:104: 00010000:00010000:3.0:1788586867.313372:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586867.313378:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313388:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586867.313390:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586867.313404:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586867.313410:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586867.313493:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313501:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586867.313528:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd96a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd96aa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586867.313547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127423104:0@lo:103: 00010000:00010000:3.0:1788586867.313568:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586867.313572:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313579:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318b000 already unused, calling callback (ffffffffc13dec20) 00000100:00100000:2.0:1788586867.313584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788586867.313586:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313594:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586867.313600:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586867.313606:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586867.313623:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313629:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586867.313647:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313654:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd965d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9664 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586867.313668:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586867.313671:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586867.313674:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586867.313677:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586867.313687:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127423232:0@lo:103: 00000100:00100000:2.0:1788586867.313711:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586867.314145:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423104 00000100:00100000:0.0:1788586867.314150:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423104 00010000:00010000:1.0:1788586867.314168:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586867.314175:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 17 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586867.314184:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423232 00000100:00100000:1.0:1788586867.314191:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423232 00010000:00010000:1.0:1788586867.314214:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 18 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586867.314260:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788586867.314270:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3648:x1875469127423104:12345-0@lo:103: 00000100:00100000:1.0:1788586867.314272:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586867.314285:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3648:x1875469127423232:12345-0@lo:103: 00010000:00010000:0.0:1788586867.314286:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586867.314295:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.314298:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586867.314306:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 18 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586867.314322:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.314336:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 18 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586867.317647:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd96aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd96a3 expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586867.317670:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586867.317759:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3648:x1875469127423104:12345-0@lo:103: Request processed in 3483us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586867.317787:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788586867.317810:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318bc00/0xfbc93bbea5fd9664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd965d expref: 16 pid: 6514 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317826:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317836:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586867.317839:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127423104:0@lo:103: 20000000:01000000:1.0:1788586867.317859:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009246794s 00010000:00010000:1.0:1788586867.317865:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317872:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317889:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317896:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317902:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788586867.317907:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317916:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317934:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.317957:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586867.317996:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3648:x1875469127423232:12345-0@lo:103: Request processed in 3714us (4283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586867.318005:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586867.318039:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127423232:0@lo:103: 00010000:00010000:1.0:1788586867.318063:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.318072:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586867.318078:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd976e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788586867.319819:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788586867.320097:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788586867.322332:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788586867.322586:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788586867.322793:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788586867.322995:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788586867.328996:0:9511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788586867.340284:0:9511:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788586867.340318:0:9511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788586867.340358:0:9511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788586867.340404:0:9511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788586867.340450:0:9511:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788586867.340477:0:9511:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788586867.341226:0:9511:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788586867.341488:0:9511:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788586868.052790:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127423360:0@lo:41: 00000100:00100000:3.0:1788586868.052864:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586868.052985:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423360 00000100:00100000:3.0:1788586868.052994:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423360 00000100:00100000:3.0:1788586868.053054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586868.053073:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127423360:12345-0@lo:41: 00000004:00000024:3.0:1788586868.053106:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788586868.053156:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127423360:12345-0@lo:41: Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586868.053164:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586868.053215:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127423360:0@lo:41: 00000100:00100000:3.0:1788586868.053672:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586868.053682:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127423488:0@lo:13: 00000100:00100000:3.0:1788586868.053723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586868.053975:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423488 00000100:00100000:1.0:1788586868.053982:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423488 00000100:00100000:1.0:1788586868.054030:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788586868.054039:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127423488:12345-0@lo:13: 00002000:00000024:1.0:1788586868.054069:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586868.054110:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127423488:12345-0@lo:13: Request processed in 72us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586868.054125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788586868.054686:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bbcb04e00 x1875469127423488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586868.054714:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127423488:0@lo:13: 00000100:00100000:1.0:1788586868.054864:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127423616:0@lo:13: 00000100:00100000:1.0:1788586868.054903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586868.055011:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423616 00000100:00100000:3.0:1788586868.055017:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423616 00000100:00100000:3.0:1788586868.055063:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586868.055071:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127423616:12345-0@lo:13: 00002000:00000024:3.0:1788586868.055094:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586868.055775:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127423616:12345-0@lo:13: Request processed in 703us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586868.055784:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788586868.055916:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a82295f80 x1875469127423616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586868.056128:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127423616:0@lo:13: 00010000:00010000:3.0:1788586868.182863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788586868.222811:0:9583:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586868.223112:0:9583:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788586869.205640:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586869.591028:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586869.591057:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127423744:0@lo:41: 00000100:00100000:3.0:1788586869.591129:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586869.591527:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423744 00000100:00100000:1.0:1788586869.591536:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423744 00000100:00100000:1.0:1788586869.591602:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788586869.591615:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127423744:12345-0@lo:41: 00000004:00000024:1.0:1788586869.591653:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788586869.591714:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127423744:12345-0@lo:41: Request processed in 102us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586869.591723:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788586869.591961:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127423744:0@lo:41: 00010000:00010000:3.0:1788586870.228617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586871.257235:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586872.277744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586872.661965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127424128:0@lo:400: 00000100:00100000:2.0:1788586872.662033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586872.662081:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127424640:0@lo:400: 00000100:00100000:2.0:1788586872.662105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586872.662120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127425152:0@lo:400: 00000100:00100000:2.0:1788586872.662136:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586872.662162:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788586872.662168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127424256:0@lo:400: 00000100:00100000:2.0:1788586872.662189:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586872.662205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127424768:0@lo:400: 00000100:00100000:2.0:1788586872.662227:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586872.662259:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424128 00000100:00100000:2.0:1788586872.662266:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424128 00000100:00100000:2.0:1788586872.662322:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788586872.662331:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127424128:12345-0@lo:400: 00000100:00100000:2.0:1788586872.662390:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127424128:12345-0@lo:400: Request processed in 60us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586872.662398:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788586872.662444:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424640 00000100:00100000:2.0:1788586872.662448:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424640 00000100:00100000:2.0:1788586872.662477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425152 00000100:00100000:2.0:1788586872.662480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425152 00000100:00100000:2.0:1788586872.662492:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424256 00000100:00100000:2.0:1788586872.662495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424256 00000100:00100000:2.0:1788586872.662506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586872.662512:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127424640:12345-0@lo:400: 00000100:00100000:2.0:1788586872.662541:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127424640:12345-0@lo:400: Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.662645:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127423872:0@lo:400: 00000100:00100000:3.0:1788586872.662681:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586872.662705:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127424384:0@lo:400: 00000100:00100000:3.0:1788586872.662725:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586872.662742:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127424896:0@lo:400: 00000100:00100000:3.0:1788586872.662761:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586872.662780:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788586872.662786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127424000:0@lo:400: 00000100:00100000:3.0:1788586872.662806:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586872.662816:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127424512:0@lo:400: 00000100:00100000:3.0:1788586872.662833:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586872.662842:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127425024:0@lo:400: 00000100:00100000:3.0:1788586872.662864:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586872.662887:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127423872 00000100:00100000:3.0:1788586872.662891:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127423872 00000100:00100000:3.0:1788586872.662920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788586872.662926:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3646:x1875469127423872:12345-0@lo:400: 00000100:00100000:3.0:1788586872.662969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3646:x1875469127423872:12345-0@lo:400: Request processed in 43us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.662975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788586872.663002:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424384 00000100:00100000:3.0:1788586872.663006:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424384 00000100:00100000:3.0:1788586872.663028:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586872.663033:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127424384:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663060:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127424384:12345-0@lo:400: Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586872.663082:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424768 00000100:00100000:3.0:1788586872.663085:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424768 00000100:00100000:3.0:1788586872.663108:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424896 00000100:00100000:3.0:1788586872.663111:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424896 00000100:00100000:3.0:1788586872.663125:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586872.663131:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127424768:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663161:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127424768:12345-0@lo:400: Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663166:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586872.663177:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586872.663182:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127424896:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663206:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127424896:12345-0@lo:400: Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586872.663246:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127423872:0@lo:400: 00000100:00100000:3.0:1788586872.663256:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127424384:0@lo:400: 00010000:00080000:3.0:1788586872.663292:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcaf5f80 x1875469127424896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586872.663303:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127424896:0@lo:400: 00000100:00100000:2.0:1788586872.663370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586872.663385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424000 00000100:00100000:2.0:1788586872.663388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424000 00000100:00100000:2.0:1788586872.663401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127424512 00000100:00100000:2.0:1788586872.663404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127424512 00000100:00100000:3.0:1788586872.663493:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425024 00000100:00100000:3.0:1788586872.663498:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425024 00000100:00100000:3.0:1788586872.663519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586872.663525:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127425152:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127425152:12345-0@lo:400: Request processed in 46us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586872.663589:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586872.663594:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127424256:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663619:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127424256:12345-0@lo:400: Request processed in 26us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586872.663636:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586872.663642:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127424000:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127424000:12345-0@lo:400: Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663679:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586872.663690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586872.663695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127424512:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127424512:12345-0@lo:400: Request processed in 25us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586872.663743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586872.663749:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127425024:12345-0@lo:400: 00000100:00100000:3.0:1788586872.663777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127425024:12345-0@lo:400: Request processed in 29us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586872.663783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788586872.663807:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82295180 x1875469127424000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586872.663816:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127424000:0@lo:400: 00010000:00080000:3.0:1788586872.663826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82295880 x1875469127424512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586872.663833:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127424512:0@lo:400: 00010000:00080000:3.0:1788586872.663841:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcaf4a80 x1875469127425024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586872.663848:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127425024:0@lo:400: 00010000:00080000:2.0:1788586872.663973:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82296d80 x1875469127424256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586872.663983:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127424256:0@lo:400: 00010000:00080000:2.0:1788586872.663994:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcaf5500 x1875469127424768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586872.664001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127424768:0@lo:400: 00000100:00100000:2.0:1788586872.664013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127424128:0@lo:400: 00010000:00080000:2.0:1788586872.664021:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82294e00 x1875469127424640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586872.664040:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127424640:0@lo:400: 00010000:00080000:2.0:1788586872.664051:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcaf6680 x1875469127425152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586872.664060:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127425152:0@lo:400: 00000100:00080000:2.0:1788586872.664082:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586872.664086:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788586872.664088:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586873.173261:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127425280:0@lo:13: 00000100:00100000:3.0:1788586873.173342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586873.173558:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127425408:0@lo:41: 00000100:00100000:3.0:1788586873.173607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586873.173637:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586873.173643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127425536:0@lo:13: 00000100:00100000:3.0:1788586873.173666:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586873.173695:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425280 00000100:00100000:3.0:1788586873.173702:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425280 00000100:00100000:3.0:1788586873.173740:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425536 00000100:00100000:3.0:1788586873.173743:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425536 00000100:00100000:3.0:1788586873.173767:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586873.173775:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127425280:12345-0@lo:13: 00002000:00000024:3.0:1788586873.173802:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586873.173846:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127425280:12345-0@lo:13: Request processed in 71us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586873.173853:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586873.173869:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586873.173875:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127425536:12345-0@lo:13: 00002000:00000024:3.0:1788586873.173884:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586873.173911:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127425536:12345-0@lo:13: Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586873.173917:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788586873.173953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81be1180 x1875469127425536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586873.173970:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127425536:0@lo:13: 00010000:00080000:3.0:1788586873.173996:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310aa00 x1875469127425280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586873.174007:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127425280:0@lo:13: 00000100:00100000:0.0:1788586873.174121:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425408 00000100:00100000:0.0:1788586873.174126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425408 00000100:00100000:0.0:1788586873.174154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586873.174161:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127425408:12345-0@lo:41: 00000004:00000024:0.0:1788586873.174183:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788586873.174217:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127425408:12345-0@lo:41: Request processed in 58us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586873.174223:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788586873.174520:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127425408:0@lo:41: 00000001:02000400:0.0:1788586873.241545:0:9873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788586873.301240:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788586874.130041:0:9925:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788586874.130312:0:9925:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788586874.325679:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586874.718378:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127425664:0@lo:41: 00000100:00100000:0.0:1788586874.718474:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586874.718545:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425664 00000100:00100000:0.0:1788586874.718552:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425664 00000100:00100000:0.0:1788586874.718593:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788586874.718603:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127425664:12345-0@lo:41: 00000004:00000024:0.0:1788586874.718638:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788586874.718685:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127425664:12345-0@lo:41: Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586874.718703:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788586874.718754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127425664:0@lo:41: 00010000:00010000:1.0:1788586875.348898:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586876.372635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788586876.998727:0:10026:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788586876.998951:0:10026:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788586877.274080:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586877.274090:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5bae583000 from 39 10000000:01000000:3.0:1788586877.274096:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586877.274142:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.274166:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.274178:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586877.274203:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127425792:0@lo:101: 00000100:00100000:3.0:1788586877.274284:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.274331:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.274354:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425792 00000100:00100000:3.0:1788586877.274360:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425792 00000100:00100000:3.0:1788586877.274406:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788586877.274432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127425792:12345-0@lo:101: 00010000:00010000:3.0:1788586877.275004:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586877.275024:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9775 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.275053:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.275064:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.275073:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecc600, rc 0) 00000100:00100000:3.0:1788586877.275127:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127425792:12345-0@lo:101: Request processed in 712us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.275134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788586877.275214:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127425792:0@lo:101: 00010000:00010000:2.0:1788586877.275232:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.275252:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586877.275321:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127425920:0@lo:501: 00000100:00100000:2.0:1788586877.275352:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.275383:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba054ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.275711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127425920 00000100:00100000:3.0:1788586877.275723:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127425920 00000100:00100000:3.0:1788586877.275760:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788586877.275768:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127425920:12345-0@lo:501: 00000100:00100000:3.0:1788586877.275887:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127425920:12345-0@lo:501: Request processed in 119us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.275894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788586877.275925:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127425920:0@lo:501: 00000100:00100000:3.0:1788586877.276576:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426048:0@lo:503: 00000100:00100000:3.0:1788586877.276622:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.276658:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.277600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426048 00000100:00100000:2.0:1788586877.277609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426048 00000100:00100000:2.0:1788586877.277666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788586877.277676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127426048:12345-0@lo:503: 00000100:00100000:2.0:1788586877.277817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127426048:12345-0@lo:503: Request processed in 142us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.277825:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788586877.277879:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426048:0@lo:503: 00000100:00100000:2.0:1788586877.280459:0:10039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10039:1875469127426176:0@lo:502: 00000100:00100000:2.0:1788586877.280530:0:10039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.280561:0:10039:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.280593:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426176 00000100:00100000:3.0:1788586877.280601:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426176 00000100:00100000:3.0:1788586877.280648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788586877.280657:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10039:x1875469127426176:12345-0@lo:502: 00000100:00100000:3.0:1788586877.280781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10039:x1875469127426176:12345-0@lo:502: Request processed in 124us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.280789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788586877.280871:0:10039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10039:1875469127426176:0@lo:502: 00000100:00100000:0.0:1788586877.280916:0:10039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10039:1875469127426304:0@lo:502: 00000100:00100000:0.0:1788586877.280962:0:10039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.280983:0:10039:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.281087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426304 00000100:00100000:3.0:1788586877.281092:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426304 00000100:00100000:3.0:1788586877.281126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788586877.281133:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10039:x1875469127426304:12345-0@lo:502: 00000100:00100000:3.0:1788586877.281201:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10039:x1875469127426304:12345-0@lo:502: Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.281207:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788586877.281542:0:10039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10039:1875469127426304:0@lo:502: 00000040:00080000:1.0:1788586877.281565:0:10039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788586877.281715:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788586877.281737:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586877.281746:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.281764:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586877.281773:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788586877.281776:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788586877.281779:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586877.281803:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.281811:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.281821:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586877.281833:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426432:0@lo:101: 00000100:00100000:3.0:1788586877.281861:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.281982:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.283288:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426432 00000100:00100000:0.0:1788586877.283298:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426432 00000100:00100000:1.0:1788586877.283407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788586877.283431:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127426432:12345-0@lo:101: 00010000:00010000:1.0:1788586877.283456:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586877.283475:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9783 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586877.283516:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586877.283528:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586877.283537:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318aa00, rc 0) 00000100:00100000:1.0:1788586877.283602:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127426432:12345-0@lo:101: Request processed in 187us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.283609:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788586877.283882:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426432:0@lo:101: 00010000:00010000:3.0:1788586877.283901:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.283909:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586877.284073:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426560:0@lo:501: 00000100:00100000:3.0:1788586877.284108:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.284152:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.284273:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426560 00000100:00100000:1.0:1788586877.284278:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426560 00000100:00100000:1.0:1788586877.284348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788586877.284357:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127426560:12345-0@lo:501: 00000100:00100000:2.0:1788586877.284548:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127426560:12345-0@lo:501: Request processed in 192us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.284592:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426560:0@lo:501: 00000100:00100000:3.0:1788586877.284618:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426688:0@lo:503: 00000100:00100000:2.0:1788586877.284629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788586877.284660:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.284683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426688 00000100:00100000:3.0:1788586877.284687:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.284688:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426688 00000100:00100000:2.0:1788586877.284789:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788586877.284798:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127426688:12345-0@lo:503: 00000100:00100000:2.0:1788586877.284957:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127426688:12345-0@lo:503: Request processed in 160us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.284965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788586877.285033:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127426688:0@lo:503: 00000100:00100000:0.0:1788586877.285707:0:10040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10040:1875469127426816:0@lo:502: 00000100:00100000:0.0:1788586877.285752:0:10040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.285783:0:10040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.285838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426816 00000100:00100000:3.0:1788586877.285844:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426816 00000100:00100000:3.0:1788586877.285879:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788586877.285887:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10040:x1875469127426816:12345-0@lo:502: 00000100:00100000:3.0:1788586877.285996:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10040:x1875469127426816:12345-0@lo:502: Request processed in 109us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.286004:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788586877.286140:0:10040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10040:1875469127426816:0@lo:502: 00000020:01000000:2.0:1788586877.286164:0:10040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586877.286173:0:10040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586877.286175:0:10040:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788586877.286180:0:10040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788586877.286181:0:10040:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788586877.286197:0:10040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10040:1875469127426944:0@lo:502: 00000100:00100000:2.0:1788586877.286227:0:10040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.286257:0:10040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.286301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127426944 00000100:00100000:0.0:1788586877.286305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127426944 00000100:00100000:0.0:1788586877.286335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788586877.286342:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10040:x1875469127426944:12345-0@lo:502: 00000100:00100000:0.0:1788586877.286654:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10040:x1875469127426944:12345-0@lo:502: Request processed in 311us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.286661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788586877.288302:0:10040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10040:1875469127426944:0@lo:502: 00000020:01000000:2.0:1788586877.288345:0:10040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586877.288353:0:10040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586877.288355:0:10040:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788586877.288360:0:10040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788586877.288734:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788586877.288754:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788586877.288765:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586877.288776:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586877.288787:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788586877.288789:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5baaa5e000 from 39 10000000:01000000:1.0:1788586877.288792:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586877.288826:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586877.288846:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586877.288857:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586877.288875:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427072:0@lo:101: 00000100:00100000:1.0:1788586877.288929:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.288978:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eefc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.289085:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427072 00000100:00100000:2.0:1788586877.289092:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427072 00000100:00100000:2.0:1788586877.289142:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788586877.289152:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127427072:12345-0@lo:101: 00010000:00010000:2.0:1788586877.289165:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586877.289178:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9791 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.289202:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.289212:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.289221:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7600, rc 0) 00000100:00100000:2.0:1788586877.289271:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127427072:12345-0@lo:101: Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.289278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788586877.289313:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427072:0@lo:101: 00010000:00010000:2.0:1788586877.289325:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.289335:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586877.289384:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427200:0@lo:501: 00000100:00100000:2.0:1788586877.289407:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.289482:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.289522:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427200 00000100:00100000:2.0:1788586877.289534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427200 00000100:00100000:2.0:1788586877.289552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788586877.289557:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127427200:12345-0@lo:501: 00000100:00100000:2.0:1788586877.289695:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127427200:12345-0@lo:501: Request processed in 137us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.289702:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788586877.289741:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427200:0@lo:501: 00000100:00100000:2.0:1788586877.289765:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427328:0@lo:503: 00000100:00100000:2.0:1788586877.289801:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.289814:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.289824:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427328 00000100:00100000:2.0:1788586877.289827:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427328 00000100:00100000:2.0:1788586877.289845:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788586877.289850:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127427328:12345-0@lo:503: 00000100:00100000:2.0:1788586877.289918:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127427328:12345-0@lo:503: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.289924:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788586877.290550:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427328:0@lo:503: 00000100:00100000:2.0:1788586877.291199:0:10042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10042:1875469127427456:0@lo:502: 00000100:00100000:2.0:1788586877.291257:0:10042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.291291:0:10042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.291336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427456 00000100:00100000:0.0:1788586877.291342:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427456 00000100:00100000:0.0:1788586877.291382:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788586877.291390:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10042:x1875469127427456:12345-0@lo:502: 00000100:00100000:0.0:1788586877.291634:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10042:x1875469127427456:12345-0@lo:502: Request processed in 244us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.291642:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788586877.291747:0:10042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10042:1875469127427456:0@lo:502: 00000100:00100000:2.0:1788586877.291788:0:10042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10042:1875469127427584:0@lo:502: 00000100:00100000:2.0:1788586877.291819:0:10042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.291844:0:10042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.291888:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427584 00000100:00100000:1.0:1788586877.291892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427584 00000100:00100000:1.0:1788586877.291916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788586877.291922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10042:x1875469127427584:12345-0@lo:502: 00000100:00100000:1.0:1788586877.292072:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10042:x1875469127427584:12345-0@lo:502: Request processed in 149us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.292079:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788586877.292182:0:10042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10042:1875469127427584:0@lo:502: 00000040:00080000:2.0:1788586877.292202:0:10042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788586877.292357:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788586877.292378:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586877.292386:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.292396:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586877.292406:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788586877.292408:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5baaa5e000 from 6 10000000:01000000:0.0:1788586877.292411:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788586877.292528:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.292537:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.292545:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.292558:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427712:0@lo:101: 00000100:00100000:0.0:1788586877.292588:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.292605:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.292704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427712 00000100:00100000:2.0:1788586877.292708:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427712 00000100:00100000:2.0:1788586877.292742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788586877.292749:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127427712:12345-0@lo:101: 00010000:00010000:2.0:1788586877.292758:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586877.292771:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd97a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd979f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.292791:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd97a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd979f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.292801:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd97a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd979f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586877.292810:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7000, rc 0) 00000100:00100000:2.0:1788586877.292837:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127427712:12345-0@lo:101: Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.292844:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788586877.292929:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427712:0@lo:101: 00010000:00010000:0.0:1788586877.293009:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.293018:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.293071:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427840:0@lo:256: 00000100:00100000:0.0:1788586877.293100:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.293161:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.296664:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427840 00000100:00100000:1.0:1788586877.296682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427840 00000100:00100000:1.0:1788586877.296734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788586877.296743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127427840:12345-0@lo:256: 20000000:01000000:1.0:1788586877.296770:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788586877.296788:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788586877.296792:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788586877.296913:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127427840:12345-0@lo:256: Request processed in 170us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.296920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788586877.297053:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427840:0@lo:256: 10000000:01000000:0.0:1788586877.297107:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788586877.297117:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297128:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586877.297137:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788586877.297140:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788586877.297143:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788586877.297172:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297180:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297188:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.297206:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427968:0@lo:101: 00000100:00100000:0.0:1788586877.297250:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.297281:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.297296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127427968 00000100:00100000:0.0:1788586877.297305:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127427968 00000100:00100000:0.0:1788586877.297331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788586877.297338:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127427968:12345-0@lo:101: 00010000:00010000:0.0:1788586877.297346:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586877.297360:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd97ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297384:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297394:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297403:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030c00, rc 0) 00000100:00100000:0.0:1788586877.297462:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127427968:12345-0@lo:101: Request processed in 124us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.297467:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788586877.297503:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127427968:0@lo:101: 00010000:00010000:0.0:1788586877.297515:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.297524:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.297579:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127428096:0@lo:501: 00000100:00100000:0.0:1788586877.297604:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.297616:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.297628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428096 00000100:00100000:0.0:1788586877.297631:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428096 00000100:00100000:0.0:1788586877.297659:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788586877.297665:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127428096:12345-0@lo:501: 00000100:00100000:0.0:1788586877.297776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127428096:12345-0@lo:501: Request processed in 111us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.297782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788586877.297825:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127428096:0@lo:501: 00000100:00100000:0.0:1788586877.297850:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127428224:0@lo:503: 00000100:00100000:0.0:1788586877.297887:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.297899:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.297909:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428224 00000100:00100000:0.0:1788586877.297913:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428224 00000100:00100000:0.0:1788586877.297945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788586877.297953:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127428224:12345-0@lo:503: 00000100:00100000:0.0:1788586877.298022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127428224:12345-0@lo:503: Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.298029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788586877.298066:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127428224:0@lo:503: 00000100:00100000:0.0:1788586877.298285:0:10043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10043:1875469127428352:0@lo:502: 00000100:00100000:0.0:1788586877.298315:0:10043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.298333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428352 00000100:00100000:0.0:1788586877.298336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428352 00000100:00100000:0.0:1788586877.298356:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788586877.298362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10043:x1875469127428352:12345-0@lo:502: 00000100:00100000:0.0:1788586877.298450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10043:x1875469127428352:12345-0@lo:502: Request processed in 87us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.298465:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788586877.298494:0:10043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.298505:0:10043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10043:1875469127428352:0@lo:502: 00000020:01000000:0.0:1788586877.298526:0:10043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788586877.298533:0:10043:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788586877.298541:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586877.298544:0:10043:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788586877.298549:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788586877.298553:0:10043:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:0.0:1788586877.298576:0:10043:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788586877.298580:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788586877.298595:0:10043:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f5a826e99c0) 00000020:00000080:0.0:1788586877.298616:0:10043:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788586877.298622:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788586877.298706:0:10043:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788586877.298712:0:10043:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788586877.298719:0:10043:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fd97c2 00010000:00080000:0.0:1788586877.298746:0:10043:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a8227f800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788586877.298982:0:10043:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788586877.299091:0:10043:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788586877.299101:0:10043:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788586877.299269:0:10043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586877.299382:0:10043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586877.299541:0:10043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788586877.299639:0:10043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788586877.300730:0:10044:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788586877.300741:0:10044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788586877.301343:0:10043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788586877.301354:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788586877.301390:0:10043:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788586877.301411:0:10043:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd97c9 00000100:00080000:3.0:1788586877.301524:0:10043:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788586877.301531:0:10043:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f5a8227f800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788586877.301567:0:10043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83108000 x1875469127428480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788586877.301589:0:10043:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788586877.301638:0:10043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586877.301643:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586877.301645:0:10043:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788586877.301648:0:10043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586877.301651:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586877.301660:0:10043:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788586877.301665:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788586877.301666:0:10043:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788586877.301693:0:10043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10043:1875469127428608:0@lo:502: 00000100:00100000:3.0:1788586877.301764:0:10043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.301806:0:10043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.301874:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127428480:0@lo:8: 00000100:00100000:2.0:1788586877.301909:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.302057:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428480 00000100:00100000:3.0:1788586877.302064:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428480 00000100:00100000:3.0:1788586877.302101:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586877.302109:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875469127428480:12345-0@lo:8: 00010000:00080000:3.0:1788586877.302133:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788586877.302154:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fd97d0 00002000:00100000:3.0:1788586877.302167:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f5a81bc8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788586877.302171:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788586877.302175:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788586877.302228:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788586877.302629:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127428992:0@lo:400: 00000100:00100000:1.0:1788586877.302675:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.302696:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127429504:0@lo:400: 00000100:00100000:1.0:1788586877.302715:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.302732:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788586877.302738:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127428864:0@lo:400: 00000100:00100000:1.0:1788586877.302757:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.302772:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127429376:0@lo:400: 00000100:00100000:1.0:1788586877.302791:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.302807:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127429888:0@lo:400: 00000100:00100000:1.0:1788586877.302829:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.302855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428992 00000100:00100000:1.0:1788586877.302859:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428992 00000100:00100000:1.0:1788586877.302886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429376 00000100:00100000:1.0:1788586877.302888:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429376 00000100:00100000:1.0:1788586877.302910:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429888 00000100:00100000:1.0:1788586877.302912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429888 00000100:00100000:1.0:1788586877.302925:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788586877.302931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127428992:12345-0@lo:400: 00000100:00100000:2.0:1788586877.303035:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788586877.303044:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788586877.303203:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428608 00000100:00100000:0.0:1788586877.303207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428608 00000100:00100000:0.0:1788586877.303237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788586877.303255:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:10043:x1875469127428608:12345-0@lo:502: 00000100:00100000:0.0:1788586877.303371:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:10043:x1875469127428608:12345-0@lo:502: Request processed in 127us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.303378:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788586877.303440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127428736:0@lo:400: 00000100:00100000:0.0:1788586877.303480:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.303494:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127429248:0@lo:400: 00000100:00100000:0.0:1788586877.303511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.303521:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127429760:0@lo:400: 00000100:00100000:0.0:1788586877.303536:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.303549:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788586877.303554:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127429120:0@lo:400: 00000100:00100000:0.0:1788586877.303573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.303589:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127429632:0@lo:400: 00000100:00100000:0.0:1788586877.303607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.303631:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788586877.303636:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788586877.303729:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428864 00000100:00100000:0.0:1788586877.303733:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428864 00000100:00100000:0.0:1788586877.303755:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429120 00000100:00100000:0.0:1788586877.303757:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429120 00000100:00100000:0.0:1788586877.303770:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788586877.303775:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127428864:12345-0@lo:400: 00000100:00100000:1.0:1788586877.303847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127428992:12345-0@lo:400: Request processed in 915us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.303854:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788586877.303867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127428736 00000100:00100000:1.0:1788586877.303870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127428736 00000100:00100000:1.0:1788586877.303883:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429248 00000100:00100000:1.0:1788586877.303885:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429248 00000100:00100000:1.0:1788586877.303897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429760 00000100:00100000:1.0:1788586877.303906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429760 00000100:00100000:1.0:1788586877.303923:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788586877.303929:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127429376:12345-0@lo:400: 00002000:00080000:3.0:1788586877.304133:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788586877.304172:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bc9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586877.304217:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875469127428480:12345-0@lo:8: Request processed in 2107us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.304224:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586877.304237:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429504 00000100:00100000:3.0:1788586877.304250:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429504 00000100:00100000:3.0:1788586877.304269:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127429632 00000100:00100000:3.0:1788586877.304272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127429632 00000100:00100000:3.0:1788586877.304286:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586877.304292:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127429504:12345-0@lo:400: 00000100:00100000:0.0:1788586877.304378:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127428864:12345-0@lo:400: Request processed in 602us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.304386:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788586877.304400:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788586877.304407:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127429120:12345-0@lo:400: 00000100:00100000:0.0:1788586877.304476:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127429120:12345-0@lo:400: Request processed in 70us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.304482:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788586877.304522:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127429120:0@lo:400: 00000100:00100000:3.0:1788586877.307744:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127429504:12345-0@lo:400: Request processed in 3443us (5017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.307769:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788586877.307807:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586877.307820:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127429632:12345-0@lo:400: 00000100:00100000:3.0:1788586877.307905:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127429632:12345-0@lo:400: Request processed in 90us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.307912:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586877.308010:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788586877.308024:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586877.308032:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127429888:12345-0@lo:400: 00000100:00100000:3.0:1788586877.308066:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127429888:12345-0@lo:400: Request processed in 35us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.308072:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586877.308085:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788586877.308090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586877.308097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127428736:12345-0@lo:400: 00000100:00100000:3.0:1788586877.308119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127428736:12345-0@lo:400: Request processed in 23us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.308124:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586877.308131:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788586877.308136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788586877.308142:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127429248:12345-0@lo:400: 00000100:00100000:3.0:1788586877.308169:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127429248:12345-0@lo:400: Request processed in 27us (4656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.308174:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788586877.308183:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788586877.308189:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586877.308205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127429760:12345-0@lo:400: 00000100:00100000:3.0:1788586877.308232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127429760:12345-0@lo:400: Request processed in 29us (4695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.308237:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788586877.308296:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb04700 x1875469127429632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.308310:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127429632:0@lo:400: 00010000:00080000:3.0:1788586877.308324:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb06300 x1875469127428736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.308332:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127428736:0@lo:400: 00010000:00080000:3.0:1788586877.308343:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb04e00 x1875469127429248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.308351:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127429248:0@lo:400: 00010000:00080000:3.0:1788586877.308362:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb05af800 x1875469127429760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.308370:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127429760:0@lo:400: 00010000:00080000:3.0:1788586877.308510:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83108000 x1875469127428480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788586887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.308519:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788586877.308527:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788586877.308535:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788586877.308541:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788586877.308544:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a8227f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788586877.308563:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788586877.308573:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127428480:0@lo:8: 00000100:00100000:3.0:1788586877.308599:0:10043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10043:1875469127428608:0@lo:502: 00000020:01000000:3.0:1788586877.308627:0:10043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586877.308634:0:10043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586877.308636:0:10043:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788586877.308641:0:10043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1788586877.308705:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788586877.308725:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788586877.308736:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.308747:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586877.308758:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586877.308760:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5b86e73000 from 39 10000000:01000000:3.0:1788586877.308764:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586877.308793:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.308802:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.308810:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586877.308827:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430016:0@lo:101: 00000100:00100000:3.0:1788586877.308864:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.308892:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.308907:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430016 00000100:00100000:3.0:1788586877.308918:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430016 00000100:00100000:1.0:1788586877.309035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127429376:12345-0@lo:400: Request processed in 5104us (6242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.309044:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788586877.309062:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788586877.309067:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788586877.309069:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788586877.309227:0:10044:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788586877.309311:0:10044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 223239894587ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788586877.309318:0:10044:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1788586877.309821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb07800 x1875469127428992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586877.309834:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127428992:0@lo:400: 00000100:00100000:3.0:1788586877.310053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788586877.310063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127430016:12345-0@lo:101: 00010000:00010000:3.0:1788586877.310076:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586877.310091:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd97d7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.310114:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.310125:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.310134:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecde00, rc 0) 00000100:00100000:3.0:1788586877.310179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127430016:12345-0@lo:101: Request processed in 119us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.310185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788586877.310223:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430016:0@lo:101: 00010000:00010000:3.0:1788586877.310237:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.310258:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586877.310320:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430144:0@lo:501: 00000100:00100000:3.0:1788586877.310348:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.310373:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.310386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430144 00000100:00100000:3.0:1788586877.310390:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430144 00000100:00100000:3.0:1788586877.310443:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788586877.311017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127430144:12345-0@lo:501: 00000100:00100000:3.0:1788586877.311130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127430144:12345-0@lo:501: Request processed in 681us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.311137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788586877.311171:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430144:0@lo:501: 00000100:00100000:3.0:1788586877.311200:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430272:0@lo:503: 00000100:00100000:3.0:1788586877.311239:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.311274:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.311287:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430272 00000100:00100000:3.0:1788586877.311290:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430272 00000100:00100000:3.0:1788586877.311309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788586877.311315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127430272:12345-0@lo:503: 00000100:00100000:3.0:1788586877.311383:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127430272:12345-0@lo:503: Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.311390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788586877.311529:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430272:0@lo:503: 00010000:00080000:3.0:1788586877.314620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb05500 x1875469127429504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.314643:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127429504:0@lo:400: 00000100:00100000:3.0:1788586877.314685:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127428864:0@lo:400: 00010000:00080000:3.0:1788586877.314698:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb05880 x1875469127429376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.314707:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127429376:0@lo:400: 00010000:00080000:3.0:1788586877.314737:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb05ae680 x1875469127429888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.314745:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127429888:0@lo:400: 00000004:00080000:3.0:1788586877.317035:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788586877.319651:0:10049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10049:1875469127430400:0@lo:502: 00000100:00100000:1.0:1788586877.319737:0:10049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.319779:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430400 00000100:00100000:1.0:1788586877.319787:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430400 00000100:00100000:1.0:1788586877.319833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788586877.319842:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10049:x1875469127430400:12345-0@lo:502: 00000100:00100000:1.0:1788586877.319963:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10049:x1875469127430400:12345-0@lo:502: Request processed in 121us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.319970:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788586877.320017:0:10049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.320037:0:10049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10049:1875469127430400:0@lo:502: 00000100:00100000:1.0:1788586877.320080:0:10049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10049:1875469127430528:0@lo:502: 00000100:00100000:1.0:1788586877.320114:0:10049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586877.320134:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430528 00000100:00100000:1.0:1788586877.320138:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430528 00000100:00100000:1.0:1788586877.320164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788586877.320171:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10049:x1875469127430528:12345-0@lo:502: 00000100:00100000:1.0:1788586877.320227:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10049:x1875469127430528:12345-0@lo:502: Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.320234:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788586877.320272:0:10049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.320284:0:10049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10049:1875469127430528:0@lo:502: 00000040:00080000:1.0:1788586877.320303:0:10049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788586877.320756:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788586877.320777:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586877.320788:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.320798:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586877.320808:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788586877.320811:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5b86e73000 from 6 10000000:01000000:3.0:1788586877.320814:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788586877.320838:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.320846:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586877.320855:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586877.320869:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430656:0@lo:101: 00000100:00100000:3.0:1788586877.320900:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.320919:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.321058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430656 00000100:00100000:0.0:1788586877.321063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430656 00000100:00100000:0.0:1788586877.321106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788586877.321114:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127430656:12345-0@lo:101: 00010000:00010000:0.0:1788586877.321123:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586877.321135:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd97ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd97e5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321157:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd97ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97e5 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321167:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd97ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97e5 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321176:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030a00, rc 0) 00000100:00100000:0.0:1788586877.321209:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127430656:12345-0@lo:101: Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.321215:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788586877.321260:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430656:0@lo:101: 00010000:00010000:0.0:1788586877.321272:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321280:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.321334:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430784:0@lo:256: 00000100:00100000:0.0:1788586877.321376:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.321390:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.321401:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430784 00000100:00100000:0.0:1788586877.321405:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430784 00000100:00100000:0.0:1788586877.321441:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788586877.321520:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127430784:12345-0@lo:256: 20000000:01000000:0.0:1788586877.321535:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788586877.321551:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788586877.321555:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788586877.321625:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127430784:12345-0@lo:256: Request processed in 177us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.321632:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788586877.321665:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430784:0@lo:256: 10000000:01000000:0.0:1788586877.321709:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788586877.321715:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321722:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586877.321729:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788586877.321731:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788586877.321733:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788586877.321749:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321766:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321774:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.321785:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430912:0@lo:101: 00000100:00100000:0.0:1788586877.321810:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.321824:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.321835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127430912 00000100:00100000:0.0:1788586877.321838:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127430912 00000100:00100000:0.0:1788586877.321855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788586877.321860:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127430912:12345-0@lo:101: 00010000:00010000:0.0:1788586877.321867:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586877.321876:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd97f3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321890:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321898:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.321904:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80031000, rc 0) 00000100:00100000:0.0:1788586877.321929:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127430912:12345-0@lo:101: Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.322594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788586877.322636:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127430912:0@lo:101: 00010000:00010000:0.0:1788586877.322654:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.322662:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.322726:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127431040:0@lo:501: 00000100:00100000:0.0:1788586877.323159:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.324045:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.325125:0:10045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127431168:0@lo:700: 00000100:00100000:2.0:1788586877.325187:0:10045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.325219:0:10045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.325684:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431040 00000100:00100000:1.0:1788586877.325693:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431040 00000100:00100000:0.0:1788586877.325729:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431168 00000100:00100000:0.0:1788586877.325733:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431168 00000100:00100000:0.0:1788586877.325810:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788586877.325820:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10045:x1875469127431168:12345-0@lo:700: 00000100:00100000:0.0:1788586877.325861:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1875469127431296:0@lo:700: 00000100:00100000:0.0:1788586877.325893:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.325911:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e6f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586877.325975:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431296 00000100:00100000:3.0:1788586877.325979:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431296 00000100:00100000:3.0:1788586877.326019:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586877.326027:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1875469127431296:12345-0@lo:700: 00000100:00080000:2.0:1788586877.331050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788586877.331202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788586877.331220:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127431040:12345-0@lo:501: 00000100:00100000:1.0:1788586877.331792:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127431040:12345-0@lo:501: Request processed in 579us (8631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.331801:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788586877.331885:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127431040:0@lo:501: 00000100:00100000:0.0:1788586877.332556:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127431424:0@lo:503: 00000100:00100000:0.0:1788586877.332618:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.332658:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.332799:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431424 00000100:00100000:1.0:1788586877.332807:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431424 00000100:00100000:1.0:1788586877.332848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788586877.332856:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127431424:12345-0@lo:503: 00000100:00100000:1.0:1788586877.333121:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127431424:12345-0@lo:503: Request processed in 264us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.333129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 40000000:02000000:1.0:1788586877.337297:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788586877.341445:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127431424:0@lo:503: 00000100:00100000:0.0:1788586877.343089:0:10052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10052:1875469127431552:0@lo:502: 00000100:00100000:0.0:1788586877.343175:0:10052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.343218:0:10052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc851a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.346492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431552 00000100:00100000:1.0:1788586877.346504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431552 00000100:00100000:1.0:1788586877.346555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788586877.346564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10052:x1875469127431552:12345-0@lo:502: 00000100:00100000:1.0:1788586877.346746:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10052:x1875469127431552:12345-0@lo:502: Request processed in 182us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.346754:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788586877.347134:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1875469127431296:12345-0@lo:700: Request processed in 21107us (21238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.347143:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788586877.347197:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb05180 x1875469127431296/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586877.347212:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1875469127431296:0@lo:700: 40000000:02000000:0.0:1788586877.347222:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1788586877.355730:0:10052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10052:1875469127431552:0@lo:502: 00000020:01000000:0.0:1788586877.355769:0:10052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788586877.355776:0:10052:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788586877.355783:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586877.355785:0:10052:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788586877.355791:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788586877.355795:0:10052:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:0.0:1788586877.355819:0:10052:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788586877.355822:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788586877.355841:0:10052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f5a826ecd40) 00000020:00000080:0.0:1788586877.355877:0:10052:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788586877.355886:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788586877.356008:0:10052:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788586877.356014:0:10052:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788586877.356021:0:10052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fd9808 00010000:00080000:0.0:1788586877.356053:0:10052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bbfa66800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788586877.356320:0:10052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788586877.357085:0:10052:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788586877.357104:0:10052:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788586877.357344:0:10052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586877.357792:0:10052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586877.357926:0:10052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788586877.358133:0:10052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788586877.358710:0:10053:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788586877.358716:0:10053:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788586877.359382:0:10052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788586877.359395:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788586877.359605:0:10052:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788586877.359635:0:10052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd980f 00000100:00080000:0.0:1788586877.359646:0:10052:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788586877.359653:0:10052:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f5bbfa66800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788586877.359691:0:10052:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bbcb07800 x1875469127431680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788586877.359718:0:10052:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788586877.359790:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127431680:0@lo:8: 00000100:00100000:3.0:1788586877.359864:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.359927:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431680 00000100:00100000:3.0:1788586877.359945:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431680 00000100:00100000:3.0:1788586877.359980:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586877.359988:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875469127431680:12345-0@lo:8: 00010000:00080000:3.0:1788586877.360015:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1788586877.360040:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fd9816 00002000:00100000:3.0:1788586877.360052:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f5a81bcc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788586877.360056:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788586877.360058:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:0.0:1788586877.360881:0:10052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586877.360888:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586877.360890:0:10052:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788586877.360894:0:10052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586877.360898:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586877.360899:0:10052:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586877.360902:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586877.360904:0:10052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788586877.360942:0:10052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10052:1875469127431808:0@lo:502: 00000100:00100000:0.0:1788586877.361006:0:10052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.361039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431808 00000100:00100000:0.0:1788586877.361044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431808 00000100:00100000:0.0:1788586877.361080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788586877.361087:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10052:x1875469127431808:12345-0@lo:502: 00000100:00100000:0.0:1788586877.361193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10052:x1875469127431808:12345-0@lo:502: Request processed in 105us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.361200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788586877.361255:0:10052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc8510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.361276:0:10052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10052:1875469127431808:0@lo:502: 00000020:01000000:0.0:1788586877.361300:0:10052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586877.361304:0:10052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586877.361306:0:10052:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788586877.361315:0:10052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1788586877.361370:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788586877.361392:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788586877.361402:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.361759:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586877.361774:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788586877.361777:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f5bb05e3380 from 1 10000000:01000000:0.0:1788586877.361780:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788586877.361806:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.361815:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.361824:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.361838:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127431936:0@lo:101: 00000100:00100000:0.0:1788586877.361868:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.361890:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.362439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127431936 00000100:00100000:0.0:1788586877.362511:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127431936 00000100:00100000:0.0:1788586877.362549:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788586877.362557:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127431936:12345-0@lo:101: 00010000:00010000:0.0:1788586877.362569:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586877.362584:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd981d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.362617:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.362629:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.362638:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4400, rc 0) 00000100:00100000:0.0:1788586877.362680:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127431936:12345-0@lo:101: Request processed in 124us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.362687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788586877.362727:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127431936:0@lo:101: 00010000:00010000:0.0:1788586877.362741:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.362750:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586877.362803:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127432064:0@lo:501: 00000100:00100000:0.0:1788586877.362830:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.362844:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.362855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432064 00000100:00100000:0.0:1788586877.362859:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432064 00000100:00100000:0.0:1788586877.362880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788586877.362887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127432064:12345-0@lo:501: 00002000:00080000:3.0:1788586877.363079:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788586877.363105:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bcf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586877.363150:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875469127431680:12345-0@lo:8: Request processed in 3162us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.363158:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788586877.363192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb07800 x1875469127431680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788586887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.363202:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788586877.363209:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788586877.363216:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788586877.363222:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788586877.363224:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa66800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788586877.363273:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127432064:12345-0@lo:501: Request processed in 385us (441us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586877.363290:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788586877.363320:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127432064:0@lo:501: 10000000:01000000:0.0:1788586877.363344:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788586877.363360:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586877.363369:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788586877.364100:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788586877.364178:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10045:x1875469127431168:12345-0@lo:700: Request processed in 38358us (38988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586877.364187:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788586877.364239:0:10045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7aa6680 x1875469127431168/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586877.364259:0:10045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127431168:0@lo:700: 00000004:00080000:3.0:1788586877.371382:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788586877.371442:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127431680:0@lo:8: 00000004:00080000:2.0:1788586877.372229:0:10053:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788586877.372328:0:10053:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223302911636ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788586877.372335:0:10053:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788586877.374683:0:10045:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788586877.374716:0:10045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127432320:0@lo:7: 00000100:00100000:2.0:1788586877.374780:0:10045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.374819:0:10045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.374839:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432320 00000100:00100000:2.0:1788586877.374846:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432320 00000100:00100000:2.0:1788586877.374894:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586877.374903:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10045:x1875469127432320:12345-0@lo:7: 00000100:00100000:3.0:1788586877.375551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127432192:0@lo:13: 00000100:00100000:3.0:1788586877.375590:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.375640:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432192 00000100:00100000:3.0:1788586877.375645:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432192 00000100:00100000:3.0:1788586877.375676:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788586877.375683:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875469127432192:12345-0@lo:13: 00002000:00000024:3.0:1788586877.375701:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788586877.375746:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875469127432192:12345-0@lo:13: Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.375752:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788586877.375789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7aa5500 x1875469127432192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.375807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127432192:0@lo:13: 00000100:00100000:3.0:1788586877.376438:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586877.377006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127432448:0@lo:13: 00000100:00100000:3.0:1788586877.377054:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.377104:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432448 00000100:00100000:3.0:1788586877.377111:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432448 00000100:00100000:3.0:1788586877.377165:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586877.377173:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127432448:12345-0@lo:13: 00002000:00000024:3.0:1788586877.377191:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788586877.377226:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127432448:12345-0@lo:13: Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.377233:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788586877.377275:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127432448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.377307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127432448:0@lo:13: 00000004:00080000:3.0:1788586877.377326:0:10054:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788586877.377345:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127432576:0@lo:7: 00000100:00100000:3.0:1788586877.377377:0:10054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.377398:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432576 00000100:00100000:3.0:1788586877.377401:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432576 00000100:00080000:1.0:1788586877.378047:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586877.379648:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586877.379664:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10054:x1875469127432576:12345-0@lo:7: 00000100:00100000:3.0:1788586877.379758:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788586877.382790:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788586877.396097:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788586877.396108:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788586877.396198:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10045:x1875469127432320:12345-0@lo:7: Request processed in 21292us (21414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.396209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788586877.396359:0:10045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7aa4a80 x1875469127432320/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586877.396373:0:10045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127432320:0@lo:7: 00000004:00080000:0.0:1788586877.396387:0:10045:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788586877.396522:0:10045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127432704:0@lo:5: 00000100:00100000:0.0:1788586877.396557:0:10045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586877.396594:0:10045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.396644:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432704 00000100:00100000:2.0:1788586877.396649:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432704 00000100:00100000:2.0:1788586877.396690:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788586877.396699:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10045:x1875469127432704:12345-0@lo:5: 00002000:00080000:2.0:1788586877.396720:0:10047:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788586877.396753:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10045:x1875469127432704:12345-0@lo:5: Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586877.396767:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788586877.396793:0:10045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb05180 x1875469127432704/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586877.396803:0:10045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127432704:0@lo:5: 00000004:00080000:2.0:1788586877.396811:0:10045:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788586877.396832:0:10045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127432832:0@lo:5: 00000100:00100000:2.0:1788586877.396865:0:10045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.396878:0:10045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169540 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.396888:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432832 00000100:00100000:2.0:1788586877.396892:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432832 00000100:00100000:2.0:1788586877.396913:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788586877.396919:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10045:x1875469127432832:12345-0@lo:5: 00002000:00080000:2.0:1788586877.397028:0:10047:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00002000:00080000:3.0:1788586877.398977:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788586877.398984:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788586877.399054:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10054:x1875469127432576:12345-0@lo:7: Request processed in 19393us (21673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.399064:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788586877.399113:0:10054:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127432576/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.399127:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127432576:0@lo:7: 00000004:00080000:3.0:1788586877.399139:0:10054:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788586877.399174:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127432960:0@lo:5: 00000100:00100000:3.0:1788586877.399202:0:10054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.399228:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127432960 00000100:00100000:3.0:1788586877.399234:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127432960 00000100:00100000:3.0:1788586877.399278:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788586877.399286:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10054:x1875469127432960:12345-0@lo:5: 00002000:00080000:3.0:1788586877.399306:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788586877.399317:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788586877.399569:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586877.401212:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10045:x1875469127432832:12345-0@lo:5: Request processed in 4288us (4341us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788586877.401222:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788586877.402205:0:10045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7aa4a80 x1875469127432832/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586877.402222:0:10045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10045:1875469127432832:0@lo:5: 00000004:00080000:2.0:1788586877.402236:0:10045:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788586877.402287:0:10045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10045:1875469127433088:0@lo:900: 00000100:00100000:2.0:1788586877.402339:0:10045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586877.402377:0:10045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169540 going to sleep for 11 seconds 00010000:00010000:2.0:1788586877.402550:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586877.402613:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433088 00000100:00100000:3.0:1788586877.402619:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433088 00000100:00100000:3.0:1788586877.402657:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586877.402665:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10045:x1875469127433088:12345-0@lo:900: 00000100:00100000:3.0:1788586877.402755:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10045:x1875469127433088:12345-0@lo:900: Request processed in 91us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586877.402763:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788586877.410116:0:10045:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7aa6680 x1875469127433088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586877.410135:0:10045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10045:1875469127433088:0@lo:900: 00000001:00080000:3.0:1788586877.413846:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1788586877.413863:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788586877.413871:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788586877.414211:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10054:x1875469127432960:12345-0@lo:5: Request processed in 14921us (15002us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788586877.414234:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788586877.417565:0:10054:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127432960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.417579:0:10054:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788586877.417586:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127432960:0@lo:5: 00000004:00080000:3.0:1788586877.417603:0:10054:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788586877.417657:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127433216:0@lo:700: 00000100:00100000:3.0:1788586877.417713:0:10054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.417821:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586877.419554:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433216 00000100:00100000:1.0:1788586877.419565:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433216 00000100:00100000:1.0:1788586877.419626:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586877.419635:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10054:x1875469127433216:12345-0@lo:700: 00000100:00100000:1.0:1788586877.439720:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10054:x1875469127433216:12345-0@lo:700: Request processed in 20077us (21998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586877.439735:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788586877.439829:0:10054:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127433216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.439844:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127433216:0@lo:700: 00000004:02000040:3.0:1788586877.447969:0:10054:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788586877.458558:0:10054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127433344:0@lo:5: 00000100:00100000:3.0:1788586877.458626:0:10054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586877.458758:0:10054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586877.460697:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433344 00000100:00100000:0.0:1788586877.460710:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433344 00000100:00100000:0.0:1788586877.460780:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586877.460790:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10054:x1875469127433344:12345-0@lo:5: 00002000:00080000:0.0:1788586877.472091:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788586877.472270:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788586877.481681:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10054:x1875469127433344:12345-0@lo:5: Request processed in 20886us (23048us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788586877.481693:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788586877.482268:0:10054:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127433344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586893 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586877.482288:0:10054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10054:1875469127433344:0@lo:5: 00000004:00080000:3.0:1788586877.482303:0:10054:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:1.0:1788586878.051654:0:10087:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788586878.051665:0:10087:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788586878.292591:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586878.292618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127433472:0@lo:41: 00000100:00100000:3.0:1788586878.292692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586878.292769:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433472 00000100:00100000:3.0:1788586878.292776:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433472 00000100:00100000:3.0:1788586878.292823:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788586878.292833:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127433472:12345-0@lo:41: 00000004:00000024:3.0:1788586878.292866:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586878.292913:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127433472:12345-0@lo:41: Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586878.292920:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788586878.292965:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127433472:0@lo:41: 00000100:00100000:3.0:1788586878.293463:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127433600:0@lo:13: 00000100:00100000:3.0:1788586878.293496:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586878.293533:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586878.293539:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127433728:0@lo:13: 00000100:00100000:3.0:1788586878.293560:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586878.293645:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433600 00000100:00100000:0.0:1788586878.293650:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433600 00000100:00100000:0.0:1788586878.293674:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433728 00000100:00100000:0.0:1788586878.293676:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433728 00000100:00100000:0.0:1788586878.293689:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586878.293695:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127433600:12345-0@lo:13: 00002000:00000024:0.0:1788586878.293716:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586878.293760:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127433600:12345-0@lo:13: Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586878.293766:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586878.293779:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586878.293785:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127433728:12345-0@lo:13: 00002000:00000024:0.0:1788586878.293794:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586878.293816:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127433728:12345-0@lo:13: Request processed in 32us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586878.293821:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788586878.294137:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83666a00 x1875469127433728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586878.294154:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127433728:0@lo:13: 00010000:00080000:3.0:1788586878.294165:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb06300 x1875469127433600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586878.294191:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127433600:0@lo:13: 00010000:00010000:0.0:1788586878.420804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586879.444602:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586879.592161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.592264:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608256 00000100:00100000:0.0:1788586879.592274:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608256 00000100:00100000:0.0:1788586879.592333:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 179 00000100:00100000:0.0:1788586879.592342:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2405:x1875469110608256:12345-192.168.203.1@tcp:250: 00010000:00080000:0.0:1788586879.592383:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8f020805-49be-45a9-ab90-7695d6719484@192.168.203.1@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1788586879.592412:0:6515:0:(genops.c:1385:class_connect()) connect: client 8f020805-49be-45a9-ab90-7695d6719484, cookie 0xfbc93bbea5fd982b 00000100:00080000:0.0:1788586879.592581:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa64800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586879.592645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+5:2405:x1875469110608256:12345-192.168.203.1@tcp:250: Request processed in 303us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.592653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 179 00000100:00100000:3.0:1788586879.596326:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.597040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608128 00000100:00100000:0.0:1788586879.597051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608128 00000100:00100000:0.0:1788586879.597218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 180 00000100:00100000:0.0:1788586879.597241:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+5:6163:x1875469110608128:12345-192.168.203.1@tcp:101: 00010000:00010000:0.0:1788586879.597259:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586879.597276:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810661 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.597302:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.597312:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.597322:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5000, rc 0) 00000100:00100000:0.0:1788586879.597390:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+6:6163:x1875469110608128:12345-192.168.203.1@tcp:101: Request processed in 162us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.597396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 180 00000100:00100000:3.0:1788586879.601662:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.602357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608384 00000100:00100000:2.0:1788586879.602368:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608384 00000100:00100000:2.0:1788586879.602452:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 181 00000100:00100000:2.0:1788586879.602462:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+6:6163:x1875469110608384:12345-192.168.203.1@tcp:501: 00000100:00100000:2.0:1788586879.602578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+6:6163:x1875469110608384:12345-192.168.203.1@tcp:501: Request processed in 116us (924us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788586879.602585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 181 00000100:00100000:3.0:1788586879.605824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.607177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608512 00000100:00100000:0.0:1788586879.607190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608512 00000100:00100000:0.0:1788586879.607273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 182 00000100:00100000:0.0:1788586879.607284:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+6:6163:x1875469110608512:12345-192.168.203.1@tcp:101: 00010000:00010000:0.0:1788586879.607315:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586879.607332:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810668 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.607375:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.607387:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.607399:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5800, rc 0) 00000100:00100000:0.0:1788586879.610800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+7:6163:x1875469110608512:12345-192.168.203.1@tcp:101: Request processed in 3506us (4974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.610813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 182 00000100:00100000:2.0:1788586879.613925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.614030:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608640 00000100:00100000:0.0:1788586879.614040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608640 00000100:00100000:0.0:1788586879.614100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 183 00000100:00100000:0.0:1788586879.614111:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+7:6163:x1875469110608640:12345-192.168.203.1@tcp:501: 00000100:00100000:0.0:1788586879.614295:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+8:6163:x1875469110608640:12345-192.168.203.1@tcp:501: Request processed in 185us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.614303:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 183 00000100:00100000:3.0:1788586879.617221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.617316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608768 00000100:00100000:2.0:1788586879.617326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608768 00000100:00100000:2.0:1788586879.617392:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 184 00000100:00100000:2.0:1788586879.617402:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+8:6163:x1875469110608768:12345-192.168.203.1@tcp:503: 00000100:00100000:2.0:1788586879.617589:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+8:6163:x1875469110608768:12345-192.168.203.1@tcp:503: Request processed in 188us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586879.617598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 184 00000100:00100000:3.0:1788586879.622294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.622554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110608896 00000100:00100000:2.0:1788586879.622564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110608896 00000100:00100000:2.0:1788586879.622674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 185 00000100:00100000:2.0:1788586879.622685:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+8:6182:x1875469110608896:12345-192.168.203.1@tcp:502: 00000100:00100000:2.0:1788586879.622869:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+8:6182:x1875469110608896:12345-192.168.203.1@tcp:502: Request processed in 185us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586879.622877:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 185 00000100:00100000:3.0:1788586879.673241:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.673325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609024 00000100:00100000:0.0:1788586879.673335:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609024 00000100:00100000:0.0:1788586879.673402:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 186 00000100:00100000:0.0:1788586879.673412:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+8:6182:x1875469110609024:12345-192.168.203.1@tcp:502: 00000100:00100000:0.0:1788586879.673618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+8:6182:x1875469110609024:12345-192.168.203.1@tcp:502: Request processed in 207us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.673637:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 186 00000100:00100000:3.0:1788586879.686463:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.687730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609152 00000100:00100000:2.0:1788586879.687745:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609152 00000100:00100000:2.0:1788586879.687815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 187 00000100:00100000:2.0:1788586879.687825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+8:6163:x1875469110609152:12345-192.168.203.1@tcp:101: 00010000:00010000:2.0:1788586879.687840:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586879.687858:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6600/0xfbc93bbea5fd9840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810699 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586879.687886:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6600/0xfbc93bbea5fd9840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810699 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586879.687898:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa6600/0xfbc93bbea5fd9840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810699 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586879.687909:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6600, rc 0) 00000100:00100000:2.0:1788586879.687977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+9:6163:x1875469110609152:12345-192.168.203.1@tcp:101: Request processed in 153us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586879.687984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 187 00000100:00100000:3.0:1788586879.702523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.703067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609280 00000100:00100000:2.0:1788586879.703078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609280 00000100:00100000:2.0:1788586879.703155:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 188 00000100:00100000:2.0:1788586879.703166:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+9:6163:x1875469110609280:12345-192.168.203.1@tcp:256: 20000000:01000000:2.0:1788586879.703193:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788586879.703217:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788586879.703236:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788586879.703240:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788586879.703244:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788586879.703246:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788586879.705396:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+9:6163:x1875469110609280:12345-192.168.203.1@tcp:256: Request processed in 2221us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586879.705409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 188 00000100:00100000:3.0:1788586879.713362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.713467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609408 00000100:00100000:0.0:1788586879.713478:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609408 00000100:00100000:0.0:1788586879.713540:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 189 00000100:00100000:0.0:1788586879.713552:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6163:x1875469110609408:12345-192.168.203.1@tcp:101: 00010000:00010000:0.0:1788586879.713567:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586879.713586:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8106a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.713615:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.713642:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586879.713651:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4200, rc 0) 00000100:00100000:0.0:1788586879.713711:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6163:x1875469110609408:12345-192.168.203.1@tcp:101: Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.713719:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 189 00000100:00100000:3.0:1788586879.729084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.729162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609536 00000100:00100000:2.0:1788586879.729173:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609536 00000100:00100000:2.0:1788586879.729240:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 190 00000100:00100000:2.0:1788586879.729250:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6163:x1875469110609536:12345-192.168.203.1@tcp:501: 00000100:00100000:2.0:1788586879.729442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6163:x1875469110609536:12345-192.168.203.1@tcp:501: Request processed in 165us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586879.729451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 190 00000100:00100000:3.0:1788586879.733252:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586879.733407:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609664 00000100:00100000:2.0:1788586879.733442:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609664 00000100:00100000:2.0:1788586879.733505:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 191 00000100:00100000:2.0:1788586879.733514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:6163:x1875469110609664:12345-192.168.203.1@tcp:503: 00000100:00100000:2.0:1788586879.733662:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:6163:x1875469110609664:12345-192.168.203.1@tcp:503: Request processed in 148us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586879.733670:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 191 00000100:00100000:3.0:1788586879.740766:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.741275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609792 00000100:00100000:0.0:1788586879.741286:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609792 00000100:00100000:0.0:1788586879.741350:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 192 00000100:00100000:0.0:1788586879.741360:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6187:x1875469110609792:12345-192.168.203.1@tcp:502: 00000100:00100000:0.0:1788586879.741547:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6187:x1875469110609792:12345-192.168.203.1@tcp:502: Request processed in 187us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.741555:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 192 00000100:00100000:3.0:1788586879.745636:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.745856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110609920 00000100:00100000:0.0:1788586879.745881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110609920 00000100:00100000:0.0:1788586879.745938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 193 00000100:00100000:0.0:1788586879.745947:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6187:x1875469110609920:12345-192.168.203.1@tcp:502: 00000100:00100000:0.0:1788586879.746090:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6187:x1875469110609920:12345-192.168.203.1@tcp:502: Request processed in 144us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.746098:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 193 00000100:00100000:3.0:1788586879.755351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586879.756179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610048 00000100:00100000:0.0:1788586879.756192:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610048 00000100:00100000:0.0:1788586879.756260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:0.0:1788586879.756274:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1875469110610048:12345-192.168.203.1@tcp:38: 00010000:00080000:0.0:1788586879.756303:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1788586879.756366:0:6522:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd984e 00000004:00100000:0.0:1788586879.756391:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788586879.756673:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586879.756757:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110610048:12345-192.168.203.1@tcp:38: Request processed in 483us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.756765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:3.0:1788586879.831053:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127433856:0@lo:41: 00000100:00100000:3.0:1788586879.831273:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586879.831750:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433856 00000100:00100000:0.0:1788586879.831760:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433856 00000100:00100000:0.0:1788586879.831861:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788586879.831881:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127433856:12345-0@lo:41: 00000004:00000024:0.0:1788586879.831929:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788586879.831989:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127433856:12345-0@lo:41: Request processed in 119us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586879.831995:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788586879.832085:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127433856:0@lo:41: 00010000:00010000:1.0:1788586880.468623:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586880.777599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586880.777646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586880.777681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586880.777788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610304 00000100:00100000:0.0:1788586880.777797:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610304 00000100:00100000:0.0:1788586880.777852:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610176 00000100:00100000:0.0:1788586880.777856:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610176 00000100:00100000:0.0:1788586880.777884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610560 00000100:00100000:0.0:1788586880.777886:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610560 00000100:00100000:0.0:1788586880.777899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:0.0:1788586880.777907:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1875469110610304:12345-192.168.203.1@tcp:38: 00010000:00080000:0.0:1788586880.777939:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1788586880.777997:0:6522:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd9855 00000004:00100000:0.0:1788586880.778020:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788586880.778253:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb25800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586880.778312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110610304:12345-192.168.203.1@tcp:38: Request processed in 404us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586880.778320:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:0.0:1788586880.778340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:0.0:1788586880.778348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:0:x1875469110610176:12345-192.168.203.1@tcp:41: 00000004:00000024:0.0:1788586880.778371:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788586880.778396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:0:x1875469110610176:12345-192.168.203.1@tcp:41: Request processed in 50us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586880.778402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:0.0:1788586880.778453:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:0.0:1788586880.778461:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110610560:12345-192.168.203.1@tcp:41: 00000004:00000024:0.0:1788586880.778472:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788586880.778492:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110610560:12345-192.168.203.1@tcp:41: Request processed in 32us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586880.778498:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00080000:1.0:1788586880.778580:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788586880.790504:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586880.790546:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586880.794496:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610432 00000100:00100000:1.0:1788586880.794515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610432 00000100:00100000:1.0:1788586880.794621:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610688 00000100:00100000:1.0:1788586880.794625:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610688 00000100:00100000:1.0:1788586880.794659:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:1.0:1788586880.794669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:0:x1875469110610432:12345-192.168.203.1@tcp:41: 00000004:00000024:1.0:1788586880.794709:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788586880.794784:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:0:x1875469110610432:12345-192.168.203.1@tcp:41: Request processed in 117us (4288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586880.794791:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:1.0:1788586880.794810:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00100000:1.0:1788586880.794817:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110610688:12345-192.168.203.1@tcp:40: 00000100:00100000:1.0:1788586880.794865:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110610688:12345-192.168.203.1@tcp:40: Request processed in 48us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586880.794871:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00080000:2.0:1788586880.795331:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586880.797705:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586880.797742:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586880.797793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586880.797831:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610816 00000100:00100000:0.0:1788586880.797848:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610816 00000100:00100000:3.0:1788586880.797855:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586880.797888:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110610944 00000100:00100000:0.0:1788586880.797893:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110610944 00000100:00100000:0.0:1788586880.797915:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:1.0:1788586880.797923:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611072 00000100:00100000:0.0:1788586880.797925:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1875469110610816:12345-192.168.203.1@tcp:8: 00000100:00100000:1.0:1788586880.797929:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611072 00010000:00080000:0.0:1788586880.797960:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1788586880.797993:0:8436:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd985c 00002000:00100000:0.0:1788586880.798006:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 207b4310-f56a-4e63-b878-60fda37c3e93/ffff8f5bbfb21800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788586880.798012:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:2.0:1788586880.798020:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1875469110610944:12345-192.168.203.1@tcp:8: 00002000:00100000:0.0:1788586880.798025:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:2.0:1788586880.798041:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1788586880.798069:0:8433:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd9863 00002000:00100000:2.0:1788586880.798075:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 207b4310-f56a-4e63-b878-60fda37c3e93/ffff8f5bbfa0c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788586880.798087:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788586880.798285:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788586880.798314:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa0e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586880.798378:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110610944:12345-192.168.203.1@tcp:8: Request processed in 356us (634us total) trans 0 rc 0/0 00002000:00080000:0.0:1788586880.798380:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788586880.798389:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00080000:0.0:1788586880.798401:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb22800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586880.798473:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110610816:12345-192.168.203.1@tcp:8: Request processed in 548us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586880.798480:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:0.0:1788586880.798543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611200 00000100:00100000:0.0:1788586880.798548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611200 00000100:00100000:0.0:1788586880.798580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 194 00000100:00100000:0.0:1788586880.798587:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110611200:12345-192.168.203.1@tcp:400: 00000100:00100000:0.0:1788586880.798620:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110611200:12345-192.168.203.1@tcp:400: Request processed in 33us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586880.798626:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 194 00000100:00100000:1.0:1788586880.813597:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:1.0:1788586880.813623:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110611072:12345-192.168.203.1@tcp:900: 00000100:00100000:1.0:1788586880.813718:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110611072:12345-192.168.203.1@tcp:900: Request processed in 107us (15924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586880.813726:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:3.0:1788586880.817466:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586880.817719:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611328 00000100:00100000:1.0:1788586880.817730:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611328 00000100:00100000:1.0:1788586880.817774:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:1.0:1788586880.817784:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110611328:12345-192.168.203.1@tcp:33: 00000004:00080000:1.0:1788586880.864800:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46931us 00000004:00200000:2.0:1788586880.901089:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788586880.901195:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:6163:x1875469110611328:12345-192.168.203.1@tcp:33: Request processed in 83408us (83772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586880.901210:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:0.0:1788586881.085170:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586881.085239:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611456 00000100:00100000:1.0:1788586881.085249:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611456 00000100:00100000:1.0:1788586881.085304:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:1.0:1788586881.085315:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:6205:x1875469110611456:12345-192.168.203.1@tcp:101: 00010000:00010000:1.0:1788586881.085334:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586881.085359:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fd986a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8106d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586881.085444:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fd9871 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586881.085474:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fd9871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586881.085488:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fd9871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586881.085536:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788586881.085540:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788586881.085555:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fd9871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586881.085581:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fd986a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106d1 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586881.085599:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fd9871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106d1 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586881.085607:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83579000) 00010000:00010000:1.0:1788586881.085610:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788586881.085614:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318bc00, rc 0) 00000100:00100000:1.0:1788586881.085681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:6205:x1875469110611456:12345-192.168.203.1@tcp:101: Request processed in 368us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586881.085689:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 13 00010000:00010000:2.0:1788586881.492608:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586882.390654:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127434368:0@lo:400: 00000100:00100000:2.0:1788586882.390734:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.390795:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127434880:0@lo:400: 00000100:00100000:2.0:1788586882.390820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.390844:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127435392:0@lo:400: 00000100:00100000:2.0:1788586882.390866:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.390903:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788586882.390910:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127433984:0@lo:400: 00000100:00100000:2.0:1788586882.390940:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.390964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127434496:0@lo:400: 00000100:00100000:2.0:1788586882.390993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.391013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127435136:0@lo:400: 00000100:00100000:3.0:1788586882.391035:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434496 00000100:00100000:3.0:1788586882.391044:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434496 00000100:00100000:2.0:1788586882.391060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.391078:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127435520:0@lo:400: 00000100:00100000:3.0:1788586882.391093:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788586882.391100:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586882.391103:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127434496:12345-0@lo:400: 00000100:00100000:2.0:1788586882.391126:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434880 00000100:00100000:2.0:1788586882.391130:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434880 00000100:00100000:2.0:1788586882.391178:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435136 00000100:00100000:2.0:1788586882.391182:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435136 00000100:00100000:3.0:1788586882.391184:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127434496:12345-0@lo:400: Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586882.391192:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788586882.391199:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435520 00000100:00100000:2.0:1788586882.391201:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435520 00000100:00100000:3.0:1788586882.391226:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127434240:0@lo:400: 00000100:00100000:2.0:1788586882.391232:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586882.391239:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127434880:12345-0@lo:400: 00000100:00100000:3.0:1788586882.391251:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788586882.391260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586882.391267:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586882.391270:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127434752:0@lo:400: 00000100:00100000:2.0:1788586882.391272:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127434880:12345-0@lo:400: Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391278:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788586882.391288:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586882.391293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.391294:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788586882.391304:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127435136:12345-0@lo:400: 00000100:00100000:2.0:1788586882.391305:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127435520:12345-0@lo:400: 00000100:00100000:3.0:1788586882.391312:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127435264:0@lo:400: 00000100:00100000:3.0:1788586882.391329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.391334:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127435520:12345-0@lo:400: Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391340:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788586882.391347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788586882.391354:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127434112:0@lo:400: 00000100:00100000:1.0:1788586882.391370:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127435136:12345-0@lo:400: Request processed in 72us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391373:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434240 00000100:00100000:2.0:1788586882.391377:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434240 00000100:00100000:1.0:1788586882.391388:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586882.391452:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788586882.391454:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434368 00000100:00100000:1.0:1788586882.391460:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434368 00000100:00100000:3.0:1788586882.391461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.391461:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127434240:12345-0@lo:400: 00000100:00100000:3.0:1788586882.391480:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127434624:0@lo:400: 00000100:00100000:1.0:1788586882.391487:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435392 00000100:00100000:1.0:1788586882.391492:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435392 00000100:00100000:2.0:1788586882.391499:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127434240:12345-0@lo:400: Request processed in 39us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391506:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788586882.391507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586882.391519:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434752 00000100:00100000:3.0:1788586882.391523:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127435008:0@lo:13: 00000100:00100000:1.0:1788586882.391524:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434752 00000100:00100000:1.0:1788586882.391548:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435264 00000100:00100000:1.0:1788586882.391552:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435264 00000100:00100000:3.0:1788586882.391556:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586882.391561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127434496:0@lo:400: 00000100:00100000:1.0:1788586882.391571:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434112 00000100:00100000:1.0:1788586882.391575:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434112 00000100:00100000:3.0:1788586882.391577:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127435648:0@lo:400: 00010000:00080000:2.0:1788586882.391587:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca79880 x1875469127435136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586882.391591:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127434624 00000100:00100000:1.0:1788586882.391596:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127434624 00000100:00100000:2.0:1788586882.391601:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127435136:0@lo:400: 00000100:00100000:3.0:1788586882.391602:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788586882.391615:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca7ad80 x1875469127435520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586882.391620:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788586882.391625:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127434240:0@lo:400: 00000100:00100000:2.0:1788586882.391628:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788586882.391633:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127434368:12345-0@lo:400: 00000100:00100000:2.0:1788586882.391642:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127435520:0@lo:400: 00000100:00100000:3.0:1788586882.391654:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788586882.391655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78700 x1875469127434880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586882.391664:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127434880:0@lo:400: 00000100:00100000:3.0:1788586882.391669:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127435392:12345-0@lo:400: 00000100:00100000:1.0:1788586882.391677:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127434368:12345-0@lo:400: Request processed in 46us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586882.391685:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788586882.391693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127434368:0@lo:400: 00000100:00100000:1.0:1788586882.391705:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788586882.391707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78000 x1875469127435392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586882.391708:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127435392:12345-0@lo:400: Request processed in 41us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586882.391718:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788586882.391718:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127434752:12345-0@lo:400: 00000100:00100000:2.0:1788586882.391720:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127435392:0@lo:400: 00000100:00100000:3.0:1788586882.391738:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788586882.391741:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435648 00000100:00100000:2.0:1788586882.391743:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435648 00000100:00100000:3.0:1788586882.391746:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127435264:12345-0@lo:400: 00000100:00100000:1.0:1788586882.391769:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127434752:12345-0@lo:400: Request processed in 55us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391776:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788586882.391781:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586882.391786:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127435264:12345-0@lo:400: Request processed in 39us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391786:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127435648:12345-0@lo:400: 00000100:00100000:3.0:1788586882.391794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788586882.391803:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586882.391816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788586882.391817:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127434112:12345-0@lo:400: 00000100:00100000:2.0:1788586882.391821:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127435648:12345-0@lo:400: Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586882.391827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127434624:12345-0@lo:400: 00000100:00100000:2.0:1788586882.391829:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788586882.391870:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127434112:0@lo:400: 00000100:00100000:1.0:1788586882.391873:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127434112:12345-0@lo:400: Request processed in 60us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586882.391874:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127434624:12345-0@lo:400: Request processed in 48us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586882.391885:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127434624:0@lo:400: 00000100:00100000:1.0:1788586882.391887:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788586882.391924:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586882.391928:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788586882.391930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586882.391946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127433984 00000100:00100000:1.0:1788586882.391950:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127433984 00000100:00100000:1.0:1788586882.391980:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788586882.391990:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788586882.391991:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127433984:12345-0@lo:400: 00000100:00100000:0.0:1788586882.392005:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435008 00000100:00100000:0.0:1788586882.392011:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435008 00000100:00100000:3.0:1788586882.392020:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586882.392029:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127435776:0@lo:13: 00000100:00100000:0.0:1788586882.392043:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586882.392051:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127435008:12345-0@lo:13: 00000100:00100000:3.0:1788586882.392057:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586882.392069:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127433984:12345-0@lo:400: Request processed in 81us (1126us total) trans 0 rc 0/0 00002000:00000024:0.0:1788586882.392079:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586882.392094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788586882.392119:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127435008:12345-0@lo:13: Request processed in 68us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586882.392122:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127433984:0@lo:400: 00000100:00100000:0.0:1788586882.392126:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586882.392142:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435776 00000100:00100000:0.0:1788586882.392146:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435776 00000100:00100000:0.0:1788586882.392173:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586882.392180:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127435776:12345-0@lo:13: 00002000:00000024:0.0:1788586882.392189:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586882.392239:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127435776:12345-0@lo:13: Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586882.392245:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788586882.392328:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb04700 x1875469127435776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586882.392408:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127435776:0@lo:13: 00010000:00080000:2.0:1788586882.392534:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83665500 x1875469127435008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586882.392548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127435008:0@lo:13: 00010000:00080000:2.0:1788586882.392562:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca7b100 x1875469127435648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586882.392570:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127435648:0@lo:400: 00010000:00080000:2.0:1788586882.392579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca7bb80 x1875469127434752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586882.392585:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127434752:0@lo:400: 00000100:00100000:2.0:1788586882.392595:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127435264:0@lo:400: 00010000:00010000:1.0:1788586882.518379:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788586882.905969:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000001:00080000:3.0:1788586882.905985:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788586883.179528:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586883.179737:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611584 00000100:00100000:1.0:1788586883.179747:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611584 00000100:00100000:1.0:1788586883.179825:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:1.0:1788586883.179838:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:6258:x1875469110611584:12345-192.168.203.1@tcp:41: 00000004:00000024:1.0:1788586883.179879:0:10048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788586883.180008:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:6258:x1875469110611584:12345-192.168.203.1@tcp:41: Request processed in 174us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586883.180016:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00080000:2.0:1788586883.180198:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586883.192717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586883.192803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611712 00000100:00100000:2.0:1788586883.192813:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611712 00000100:00100000:2.0:1788586883.192886:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:2.0:1788586883.192906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:6258:x1875469110611712:12345-192.168.203.1@tcp:41: 00000004:00000024:2.0:1788586883.192943:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586883.193012:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:6258:x1875469110611712:12345-192.168.203.1@tcp:41: Request processed in 116us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586883.193019:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00080000:1.0:1788586883.193964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788586883.202565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586883.202648:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611840 00000100:00100000:3.0:1788586883.202658:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611840 00000100:00100000:3.0:1788586883.202743:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788586883.202754:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:207b4310-f56a-4e63-b878-60fda37c3e93+6:6258:x1875469110611840:12345-192.168.203.1@tcp:13: 00002000:00000024:3.0:1788586883.202786:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586883.202862:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:207b4310-f56a-4e63-b878-60fda37c3e93+6:6258:x1875469110611840:12345-192.168.203.1@tcp:13: Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586883.202871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00080000:1.0:1788586883.203012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586883.208803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586883.208977:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110611968 00000100:00100000:3.0:1788586883.208987:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110611968 00000100:00080000:1.0:1788586883.209295:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586883.209467:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:3.0:1788586883.209479:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:207b4310-f56a-4e63-b878-60fda37c3e93+5:6258:x1875469110611968:12345-192.168.203.1@tcp:13: 00002000:00000024:3.0:1788586883.209505:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586883.209578:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:207b4310-f56a-4e63-b878-60fda37c3e93+5:6258:x1875469110611968:12345-192.168.203.1@tcp:13: Request processed in 100us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586883.209585:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:3.0:1788586883.412978:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127435904:0@lo:41: 00000100:00100000:3.0:1788586883.413049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586883.413148:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127435904 00000100:00100000:3.0:1788586883.413155:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127435904 00000100:00100000:3.0:1788586883.413214:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788586883.413225:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127435904:12345-0@lo:41: 00000004:00000024:3.0:1788586883.413262:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586883.413320:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127435904:12345-0@lo:41: Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586883.413327:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788586883.413381:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127435904:0@lo:41: 00000100:00100000:2.0:1788586883.414389:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586883.414404:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127436160:0@lo:13: 00000100:00100000:2.0:1788586883.414483:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586883.416853:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127436032:0@lo:13: 00000100:00100000:1.0:1788586883.416924:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586883.417240:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436160 00000100:00100000:0.0:1788586883.417249:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436160 00000100:00100000:0.0:1788586883.417280:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436032 00000100:00100000:0.0:1788586883.417282:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436032 00000100:00100000:0.0:1788586883.417295:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586883.417313:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127436160:12345-0@lo:13: 00002000:00000024:0.0:1788586883.417336:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586883.417382:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127436160:12345-0@lo:13: Request processed in 70us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586883.417388:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586883.417403:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788586883.417410:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127436032:12345-0@lo:13: 00002000:00000024:0.0:1788586883.417478:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586883.417519:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127436032:12345-0@lo:13: Request processed in 110us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586883.417525:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788586883.417644:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb05880 x1875469127436032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586883.417664:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127436032:0@lo:13: 00010000:00080000:2.0:1788586883.418181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83664700 x1875469127436160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586883.418214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127436160:0@lo:13: 00010000:00010000:2.0:1788586883.540757:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586884.575618:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586884.956943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127436288:0@lo:41: 00000100:00100000:2.0:1788586884.957028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586884.957793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436288 00000100:00100000:0.0:1788586884.957805:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436288 00000100:00100000:0.0:1788586884.957910:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586884.957921:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127436288:12345-0@lo:41: 00000004:00000024:0.0:1788586884.957958:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788586884.958030:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127436288:12345-0@lo:41: Request processed in 110us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586884.958039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586884.958247:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127436288:0@lo:41: 00000001:00100000:1.0:1788586884.962842:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00010000:00010000:2.0:1788586885.588533:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788586885.836776:0:10185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788586886.249015:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586886.249176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586886.249223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586886.249258:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586886.249288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586886.249317:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612352 00000100:00100000:3.0:1788586886.249445:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612608 00000100:00100000:3.0:1788586886.249451:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612608 00000100:00100000:3.0:1788586886.249503:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612480 00000100:00100000:3.0:1788586886.249506:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612480 00000100:00100000:3.0:1788586886.249530:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:3.0:1788586886.249540:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110612608:12345-192.168.203.1@tcp:400: 00000100:00100000:3.0:1788586886.249611:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110612608:12345-192.168.203.1@tcp:400: Request processed in 73us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586886.249618:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:3.0:1788586886.249633:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:3.0:1788586886.249639:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110612480:12345-192.168.203.1@tcp:400: 00000100:00100000:3.0:1788586886.249663:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110612480:12345-192.168.203.1@tcp:400: Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586886.249668:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00080000:3.0:1788586886.249870:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586886.249874:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586886.249953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612352 00000100:00100000:2.0:1788586886.249996:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612224 00000100:00100000:2.0:1788586886.250000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612224 00000100:00100000:2.0:1788586886.250023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:2.0:1788586886.250030:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110612352:12345-192.168.203.1@tcp:400: 00000100:00100000:2.0:1788586886.250135:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110612352:12345-192.168.203.1@tcp:400: Request processed in 32us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586886.250142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:2.0:1788586886.250158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:2.0:1788586886.250167:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110612224:12345-192.168.203.1@tcp:400: 00000100:00100000:2.0:1788586886.250202:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110612224:12345-192.168.203.1@tcp:400: Request processed in 38us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586886.250208:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00080000:3.0:1788586886.250269:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586886.250272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788586886.250891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612096 00000100:00100000:0.0:1788586886.250898:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612096 00000100:00100000:0.0:1788586886.250973:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 196 00000100:00100000:0.0:1788586886.250982:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110612096:12345-192.168.203.1@tcp:400: 00000100:00100000:0.0:1788586886.251035:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110612096:12345-192.168.203.1@tcp:400: Request processed in 54us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586886.251042:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 196 00010000:00010000:1.0:1788586886.621407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788586887.010571:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000001:00100000:2.0:1788586887.011627:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000100:00100000:3.0:1788586887.508864:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127436672:0@lo:400: 00000100:00100000:3.0:1788586887.508929:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.508987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127437184:0@lo:400: 00000100:00100000:3.0:1788586887.509013:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.509032:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127437696:0@lo:400: 00000100:00100000:3.0:1788586887.509051:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.509078:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788586887.509084:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127436800:0@lo:400: 00000100:00100000:3.0:1788586887.509105:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.509137:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127437312:0@lo:400: 00000100:00100000:3.0:1788586887.509159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.509188:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127437824:0@lo:400: 00000100:00100000:3.0:1788586887.509208:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.509240:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436672 00000100:00100000:3.0:1788586887.509247:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436672 00000100:00100000:3.0:1788586887.509306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788586887.509315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127436672:12345-0@lo:400: 00000100:00100000:3.0:1788586887.509366:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127436672:12345-0@lo:400: Request processed in 52us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.509373:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788586887.509392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437184 00000100:00100000:3.0:1788586887.509396:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437184 00000100:00100000:3.0:1788586887.509447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437696 00000100:00100000:3.0:1788586887.509450:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437696 00000100:00100000:3.0:1788586887.509464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436800 00000100:00100000:3.0:1788586887.509466:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436800 00000100:00100000:3.0:1788586887.509477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788586887.509482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127437184:12345-0@lo:400: 00000100:00100000:3.0:1788586887.509512:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127437184:12345-0@lo:400: Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.509518:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788586887.509529:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788586887.509534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127437696:12345-0@lo:400: 00000100:00100000:3.0:1788586887.509558:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127437696:12345-0@lo:400: Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.509563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788586887.509573:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788586887.509585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127436800:12345-0@lo:400: 00000100:00100000:3.0:1788586887.509612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127436800:12345-0@lo:400: Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.509618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788586887.509643:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437312 00000100:00100000:3.0:1788586887.509647:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437312 00000100:00100000:3.0:1788586887.509670:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437824 00000100:00100000:3.0:1788586887.509672:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437824 00000100:00100000:3.0:1788586887.509692:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788586887.509698:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127437312:12345-0@lo:400: 00000100:00100000:3.0:1788586887.509727:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127437312:12345-0@lo:400: Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.509732:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788586887.509742:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788586887.509747:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127437824:12345-0@lo:400: 00000100:00100000:3.0:1788586887.509771:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127437824:12345-0@lo:400: Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.509776:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788586887.509799:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586887.509802:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586887.509805:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586887.509835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127436800:0@lo:400: 00010000:00080000:3.0:1788586887.509847:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb00380 x1875469127437312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586887.509862:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127437312:0@lo:400: 00010000:00080000:3.0:1788586887.509871:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb01f80 x1875469127437824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586887.509890:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127437824:0@lo:400: 00000100:00100000:3.0:1788586887.509901:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127436672:0@lo:400: 00010000:00080000:3.0:1788586887.509909:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb03480 x1875469127437184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586887.509916:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127437184:0@lo:400: 00010000:00080000:3.0:1788586887.509924:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb01500 x1875469127437696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586887.509931:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127437696:0@lo:400: 00000100:00100000:1.0:1788586887.510097:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127436544:0@lo:400: 00000100:00100000:1.0:1788586887.510128:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510145:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127437056:0@lo:400: 00000100:00100000:1.0:1788586887.510165:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510195:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127437568:0@lo:400: 00000100:00100000:1.0:1788586887.510220:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510238:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788586887.510244:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127436416:0@lo:400: 00000100:00100000:1.0:1788586887.510271:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510295:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127436928:0@lo:400: 00000100:00100000:1.0:1788586887.510316:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127437440:0@lo:400: 00000100:00100000:1.0:1788586887.510353:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510370:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127437952:0@lo:400: 00000100:00100000:1.0:1788586887.510411:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586887.510463:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436544 00000100:00100000:1.0:1788586887.510468:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436544 00000100:00100000:1.0:1788586887.510489:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437056 00000100:00100000:1.0:1788586887.510492:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437056 00000100:00100000:1.0:1788586887.510511:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437568 00000100:00100000:1.0:1788586887.510514:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437568 00000100:00100000:1.0:1788586887.510529:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788586887.510535:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127436544:12345-0@lo:400: 00000100:00100000:1.0:1788586887.510572:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127436544:12345-0@lo:400: Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.510587:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788586887.510600:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788586887.510606:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127437056:12345-0@lo:400: 00000100:00100000:1.0:1788586887.510633:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127437056:12345-0@lo:400: Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.510639:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788586887.510649:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788586887.510655:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127437568:12345-0@lo:400: 00000100:00100000:1.0:1788586887.510706:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127437568:12345-0@lo:400: Request processed in 51us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.510711:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788586887.510730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436416 00000100:00100000:1.0:1788586887.510733:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436416 00000100:00100000:1.0:1788586887.510757:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788586887.510764:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127436416:12345-0@lo:400: 00000100:00100000:1.0:1788586887.510828:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127436416:12345-0@lo:400: Request processed in 65us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.510834:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788586887.510859:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127436928 00000100:00100000:1.0:1788586887.510862:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127436928 00000100:00100000:1.0:1788586887.510881:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788586887.510887:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127436928:12345-0@lo:400: 00000100:00100000:1.0:1788586887.510919:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127436928:12345-0@lo:400: Request processed in 33us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.510926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788586887.510948:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437440 00000100:00100000:1.0:1788586887.510956:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437440 00000100:00100000:1.0:1788586887.510982:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127437952 00000100:00100000:1.0:1788586887.510984:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127437952 00000100:00100000:1.0:1788586887.510998:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788586887.511003:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127437440:12345-0@lo:400: 00000100:00100000:1.0:1788586887.511032:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127437440:12345-0@lo:400: Request processed in 29us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.511038:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788586887.511049:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788586887.511055:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127437952:12345-0@lo:400: 00000100:00100000:1.0:1788586887.511079:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127437952:12345-0@lo:400: Request processed in 24us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586887.511084:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788586887.511099:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586887.511102:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788586887.511104:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586887.511124:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127436416:0@lo:400: 00000100:00100000:1.0:1788586887.511134:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127436928:0@lo:400: 00010000:00080000:1.0:1788586887.511144:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb02680 x1875469127437440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586887.511152:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127437440:0@lo:400: 00010000:00080000:1.0:1788586887.511162:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca79c00 x1875469127437952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586887.511168:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788586887.511190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127437952:0@lo:400: 00000100:00100000:1.0:1788586887.511200:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127436544:0@lo:400: 00000100:00100000:1.0:1788586887.511216:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127437056:0@lo:400: 00000100:00100000:1.0:1788586887.511223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127437568:0@lo:400: 00000100:00100000:1.0:1788586887.511674:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127438080:0@lo:13: 00000100:00100000:1.0:1788586887.511706:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586887.511905:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127438208:0@lo:13: 00000100:00100000:2.0:1788586887.511934:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586887.512107:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127438080 00000100:00100000:3.0:1788586887.512113:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127438080 00000100:00100000:3.0:1788586887.512136:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127438208 00000100:00100000:3.0:1788586887.512139:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127438208 00000100:00100000:3.0:1788586887.512151:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586887.512157:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127438080:12345-0@lo:13: 00002000:00000024:3.0:1788586887.512188:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586887.512227:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127438080:12345-0@lo:13: Request processed in 69us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.512233:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788586887.512246:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586887.512252:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127438208:12345-0@lo:13: 00002000:00000024:3.0:1788586887.512260:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586887.512781:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127438208:12345-0@lo:13: Request processed in 527us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586887.512788:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788586887.512849:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb05880 x1875469127438080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586887.512866:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127438080:0@lo:13: 00010000:00080000:2.0:1788586887.512920:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf9f80 x1875469127438208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586887.512933:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127438208:0@lo:13: 00010000:00010000:2.0:1788586887.636982:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586888.532603:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127438336:0@lo:13: 00000100:00100000:3.0:1788586888.532683:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586888.532773:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127438336 00000100:00100000:2.0:1788586888.532783:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127438336 00000100:00100000:2.0:1788586888.532841:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586888.532852:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127438336:12345-0@lo:13: 00002000:00000024:2.0:1788586888.532879:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586888.532929:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127438336:12345-0@lo:13: Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.532936:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788586888.532989:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83667480 x1875469127438336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586888.533016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127438336:0@lo:13: 00000100:00100000:2.0:1788586888.533189:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127438464:0@lo:13: 00000100:00100000:2.0:1788586888.533235:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.533411:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127438464 00000100:00100000:3.0:1788586888.533454:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127438464 00000100:00100000:3.0:1788586888.533506:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127438592:0@lo:41: 00000100:00100000:3.0:1788586888.533537:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.533592:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586888.533599:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127438464:12345-0@lo:13: 00002000:00000024:3.0:1788586888.533611:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586888.533637:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127438464:12345-0@lo:13: Request processed in 39us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.533642:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788586888.533671:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbfa300 x1875469127438464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586888.533683:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127438464:0@lo:13: 00000100:00100000:2.0:1788586888.533720:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127438592 00000100:00100000:2.0:1788586888.533725:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127438592 00000100:00100000:2.0:1788586888.533764:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788586888.533771:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127438592:12345-0@lo:41: 00000004:00000024:2.0:1788586888.533794:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586888.533841:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127438592:12345-0@lo:41: Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.533863:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127438592:0@lo:41: 00000100:00100000:2.0:1788586888.533884:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1788586888.662366:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788586888.870898:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff33952430 20000000:00000080:0.0:1788586888.870915:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5baf154c00 uarg=0000000000000000 20000000:01000000:0.0:1788586888.870955:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788586888.870958:0:10332:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788586888.870960:0:10332:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788586888.870965:0:10332:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788586888.870975:0:10332:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788586888.871189:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788586888.871192:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788586888.871773:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788586888.872088:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788586888.872194:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788586888.872211:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788586888.872222:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788586888.872224:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788586888.872805:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788586888.872941:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788586888.872962:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788586888.872976:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788586888.872995:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788586888.872998:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788586888.873402:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788586888.874171:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788586888.874203:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788586888.874222:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788586888.874233:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788586888.874235:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788586888.875340:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788586888.875945:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788586888.875978:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788586888.876082:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788586888.876094:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788586888.876174:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788586888.877277:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788586888.877541:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788586888.877568:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788586888.877710:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1788586888.877727:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788586888.877747:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877766:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877774:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877791:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877798:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877805:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877812:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877820:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877827:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877834:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877843:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877849:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877857:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877905:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.877922:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 9 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.877937:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127438720:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586888.878276:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878287:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878296:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127438848:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586888.878334:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878341:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 23 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878368:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127438976:0@lo:104: 00000100:00100000:0.0:1788586888.878444:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586888.878479:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878487:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 23 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878504:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439104:0@lo:104: 00000100:00100000:0.0:1788586888.878525:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586888.878545:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878552:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 23 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878559:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439232:0@lo:104: 00000100:00100000:0.0:1788586888.878588:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586888.878604:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878612:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 23 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878620:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439360:0@lo:104: 00000100:00100000:0.0:1788586888.878714:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586888.878732:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878741:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878749:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439488:0@lo:104: 00010000:00010000:0.0:1788586888.878773:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878790:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878799:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439616:0@lo:104: 00010000:00010000:0.0:1788586888.878826:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878834:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 23 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878841:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439744:0@lo:104: 00010000:00010000:0.0:1788586888.878865:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878871:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 23 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878877:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439872:0@lo:104: 00010000:00010000:0.0:1788586888.878895:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.878902:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.878908:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127440000:0@lo:104: 00000100:00100000:0.0:1788586888.878937:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcab9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586888.879410:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788586888.879461:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.879477:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.879485:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.879493:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.879503:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586888.879511:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127438976 00000100:00100000:3.0:1788586888.879517:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127438976 00000100:00100000:3.0:1788586888.879555:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439104 00000100:00100000:3.0:1788586888.879558:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439104 00000100:00100000:3.0:1788586888.879570:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439232 00000100:00100000:3.0:1788586888.879572:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439232 00000100:00100000:3.0:1788586888.879581:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439360 00000100:00100000:3.0:1788586888.879584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439360 00000100:00100000:3.0:1788586888.879592:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439488 00000100:00100000:3.0:1788586888.879594:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439488 00000100:00100000:3.0:1788586888.879601:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439616 00000100:00100000:3.0:1788586888.879603:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439616 00000100:00100000:3.0:1788586888.879612:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439744 00000100:00100000:3.0:1788586888.879614:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439744 00000100:00100000:3.0:1788586888.879728:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127439872 00000100:00100000:3.0:1788586888.879732:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127439872 00000100:00100000:3.0:1788586888.879747:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440000 00000100:00100000:3.0:1788586888.879750:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440000 00000100:00100000:3.0:1788586888.879764:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586888.879771:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:10332:x1875469127438976:12345-0@lo:104: 00010000:00010000:3.0:1788586888.879786:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.879851:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586888.879858:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:10332:x1875469127438976:12345-0@lo:104: Request processed in 87us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.879864:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586888.879888:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788586888.879894:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:10332:x1875469127439104:12345-0@lo:104: 00010000:00010000:3.0:1788586888.879903:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.879946:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586888.879953:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+10:10332:x1875469127439104:12345-0@lo:104: Request processed in 59us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.879959:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788586888.879973:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788586888.879979:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:10332:x1875469127439232:12345-0@lo:104: 00010000:00010000:1.0:1788586888.880080:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788586888.880088:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880105:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586888.880109:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880118:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586888.880125:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586888.880131:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586888.880174:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880181:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586888.880197:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880204:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80030800/0xfbc93bbea5fd981d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9824 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880228:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586888.880232:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880238:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031a00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586888.880242:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.880250:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788586888.880250:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586888.880261:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.880268:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127440128:0@lo:103: 10000000:01000000:1.0:1788586888.880268:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586888.880286:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880294:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586888.880300:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880308:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80031a00/0xfbc93bbea5fd97f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97fa expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.880316:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586888.880325:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586888.880329:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586888.880333:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586888.880353:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586888.880368:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440128 00000100:00100000:1.0:1788586888.880371:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127440256:0@lo:103: 00000100:00100000:2.0:1788586888.880374:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440128 00010000:00010000:2.0:1788586888.880407:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 24 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586888.880408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586888.880457:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440256 00000100:00100000:1.0:1788586888.880461:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440256 00010000:00010000:1.0:1788586888.880478:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 25 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586888.880499:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586888.880505:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+25:3646:x1875469127440256:12345-0@lo:103: 00010000:00010000:1.0:1788586888.880516:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586888.880521:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 25 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880530:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 25 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.880548:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586888.880575:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+25:3646:x1875469127440256:12345-0@lo:103: Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586888.880582:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586888.880618:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127440256:0@lo:103: 00010000:00010000:3.0:1788586888.880943:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.880993:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586888.881000:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+9:10332:x1875469127439232:12345-0@lo:104: Request processed in 1021us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.881008:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788586888.881030:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788586888.881038:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+8:10332:x1875469127439360:12345-0@lo:104: 00010000:00010000:3.0:1788586888.881045:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.881073:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586888.881077:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+8:10332:x1875469127439360:12345-0@lo:104: Request processed in 42us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.881083:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788586888.881144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586888.881151:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+7:10332:x1875469127439488:12345-0@lo:104: 00010000:00010000:3.0:1788586888.881158:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.881197:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788586888.881202:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+7:10332:x1875469127439488:12345-0@lo:104: Request processed in 53us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.881207:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586888.881218:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586888.881223:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:10332:x1875469127439616:12345-0@lo:104: 00010000:00010000:3.0:1788586888.881229:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.881255:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788586888.881258:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788586888.881265:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:10332:x1875469127439616:12345-0@lo:104: Request processed in 41us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.881268:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127440128:12345-0@lo:103: 00000100:00100000:3.0:1788586888.881276:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788586888.881281:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.881289:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 24 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586888.881293:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586888.881304:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:10332:x1875469127439744:12345-0@lo:104: 00010000:00010000:2.0:1788586888.881306:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 24 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.881315:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.881322:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586888.881465:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd981d expref: 24 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.881490:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127438976:0@lo:104: 00010000:00010000:0.0:1788586888.881505:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd97fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd97f3 expref: 23 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.881514:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439104:0@lo:104: 00000100:00100000:0.0:1788586888.881521:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439232:0@lo:104: 00000100:00100000:0.0:1788586888.881528:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439360:0@lo:104: 00000100:00100000:0.0:1788586888.881535:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439488:0@lo:104: 00000100:00100000:0.0:1788586888.881541:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439616:0@lo:104: 00010000:00010000:1.0:1788586888.881900:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788586888.881907:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.881913:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586888.881917:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.881935:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586888.881941:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586888.881946:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586888.881990:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.881998:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586888.882015:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882022:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd000/0xfbc93bbea5fd97d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97de expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882032:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788586888.882036:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882041:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586888.882044:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882050:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586888.882056:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586888.882067:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586888.882081:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882087:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586888.882092:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882109:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80030400/0xfbc93bbea5fd97ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd97b4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882118:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788586888.882121:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882125:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318a000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586888.882128:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882134:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586888.882139:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586888.882145:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586888.882156:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882161:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586888.882192:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882198:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9798 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882208:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586888.882211:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882216:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecda00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586888.882218:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882223:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586888.882228:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586888.882232:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586888.882244:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882249:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586888.882253:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882258:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecda00/0xfbc93bbea5fd9783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd978a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586888.882265:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586888.882271:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586888.882273:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586888.882286:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127440384:0@lo:103: 00000100:00100000:2.0:1788586888.882690:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3647:x1875469127440128:12345-0@lo:103: Request processed in 1426us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.882700:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788586888.882781:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127440768:0@lo:103: 00000100:00100000:2.0:1788586888.882877:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586888.882923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127440128:0@lo:103: 00000100:00100000:2.0:1788586888.882938:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586888.882943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127440640:0@lo:103: 00000100:00100000:2.0:1788586888.882975:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586888.883568:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127438720:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586888.883592:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb05880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127438848:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586888.883916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440768 00000100:00100000:2.0:1788586888.883922:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440768 00010000:00010000:2.0:1788586888.883954:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 22 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884127:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586888.884135:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:10332:x1875469127439744:12345-0@lo:104: Request processed in 2832us (4648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.884144:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586888.884190:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586888.884199:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:10332:x1875469127439872:12345-0@lo:104: 00010000:00010000:3.0:1788586888.884210:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884248:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586888.884253:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:10332:x1875469127439872:12345-0@lo:104: Request processed in 56us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.884258:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788586888.884270:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586888.884276:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:10332:x1875469127440000:12345-0@lo:104: 00010000:00010000:3.0:1788586888.884284:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884313:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788586888.884318:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:10332:x1875469127440000:12345-0@lo:104: Request processed in 42us (4814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.884323:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788586888.884345:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788586888.884351:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884358:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586888.884361:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884369:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586888.884387:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586888.884392:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788586888.884393:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440640 00000100:00100000:2.0:1788586888.884399:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440640 00010000:00010000:2.0:1788586888.884434:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884454:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.884459:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788586888.884466:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788586888.884470:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3647:x1875469127440768:12345-0@lo:103: 00010000:00010000:3.0:1788586888.884476:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884482:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586888.884485:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd400/0xfbc93bbea5fd9775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd977c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884489:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884499:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586888.884502:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884507:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318a200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586888.884509:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884516:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586888.884521:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586888.884526:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586888.884547:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884553:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586888.884557:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884562:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd973d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884570:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586888.884573:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884597:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318be00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586888.884600:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884602:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884612:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586888.884618:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586888.884622:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586888.884683:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318aa00/0xfbc93bbea5fd978a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9783 expref: 23 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884695:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.884727:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3647:x1875469127440768:12345-0@lo:103: Request processed in 259us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.884733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788586888.884746:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586888.884752:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3647:x1875469127440640:12345-0@lo:103: 00010000:00010000:2.0:1788586888.884759:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.884770:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 21 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884778:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 21 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884788:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9791 expref: 21 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.884796:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586888.884827:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884834:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586888.884841:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884857:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318be00/0xfbc93bbea5fd970c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9713 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.884869:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586888.884870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586888.884872:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586888.884915:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3647:x1875469127440640:12345-0@lo:103: Request processed in 156us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.884922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586888.884960:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127440640:0@lo:103: 00000100:00100000:2.0:1788586888.884969:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127440768:0@lo:103: 00000100:00100000:2.0:1788586888.884985:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586888.884993:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127441152:0@lo:103: 00000100:00100000:2.0:1788586888.885022:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586888.885052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441152 00000100:00100000:2.0:1788586888.885057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441152 00010000:00010000:2.0:1788586888.885072:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 20 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.885076:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439744:0@lo:104: 00000100:00100000:2.0:1788586888.885100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788586888.885107:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3647:x1875469127441152:12345-0@lo:103: 00010000:00010000:2.0:1788586888.885114:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.885118:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 20 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.885179:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127439872:0@lo:104: 00000100:00100000:0.0:1788586888.885189:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875469127440000:0@lo:104: 00010000:00010000:0.0:1788586888.885227:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586888.885324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586888.885346:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127440896:0@lo:103: 00000100:00100000:1.0:1788586888.885382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586888.885397:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788586888.885405:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127440512:0@lo:103: 00010000:00010000:2.0:1788586888.885410:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 20 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885440:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd800/0xfbc93bbea5fd9713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd970c expref: 20 pid: 6515 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885449:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.885486:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3647:x1875469127441152:12345-0@lo:103: Request processed in 379us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.885492:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788586888.885503:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440384 00000100:00100000:2.0:1788586888.885507:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440384 00010000:00010000:2.0:1788586888.885522:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 19 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.885535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440896 00000100:00100000:2.0:1788586888.885538:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440896 00010000:00010000:2.0:1788586888.885549:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 20 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.885565:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788586888.885572:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3648:x1875469127440384:12345-0@lo:103: 00010000:00010000:2.0:1788586888.885579:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.885583:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 20 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885591:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 20 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586888.885676:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127441152:0@lo:103: 00010000:00010000:2.0:1788586888.885690:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecde00/0xfbc93bbea5fd97de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd97d7 expref: 20 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885701:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.885726:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3648:x1875469127440384:12345-0@lo:103: Request processed in 154us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.885732:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788586888.885745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788586888.885752:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3648:x1875469127440896:12345-0@lo:103: 00010000:00010000:2.0:1788586888.885760:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.885764:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 18 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885772:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 18 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885784:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd977c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9775 expref: 18 pid: 6516 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.885794:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586888.885899:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586888.885905:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3648:x1875469127440896:12345-0@lo:103: Request processed in 153us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.885913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788586888.885928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127440512 00000100:00100000:1.0:1788586888.885928:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127441024:0@lo:103: 00000100:00100000:2.0:1788586888.885933:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127440512 00010000:00010000:2.0:1788586888.885949:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 17 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586888.885959:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586888.885963:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441024 00000100:00100000:2.0:1788586888.885972:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441024 00000100:00100000:1.0:1788586888.885979:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127440896:0@lo:103: 00000100:00100000:1.0:1788586888.886082:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127440384:0@lo:103: 00010000:00010000:2.0:1788586888.886222:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 18 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.886240:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788586888.886248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:3648:x1875469127440512:12345-0@lo:103: 00010000:00010000:2.0:1788586888.886256:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.886260:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 18 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.886268:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 18 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.886280:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd97b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd97ad expref: 18 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.886289:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.886327:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3648:x1875469127440512:12345-0@lo:103: Request processed in 81us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.886333:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788586888.886362:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788586888.886367:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3648:x1875469127441024:12345-0@lo:103: 00010000:00010000:2.0:1788586888.886374:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.886378:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.886386:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.886395:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecc200/0xfbc93bbea5fd973d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9736 expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.886410:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.886454:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3648:x1875469127441024:12345-0@lo:103: Request processed in 85us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.886460:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586888.886541:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127440512:0@lo:103: 00000100:00100000:3.0:1788586888.886553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127441024:0@lo:103: 00000100:00100000:2.0:1788586888.886559:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586888.886591:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612736 00000100:00100000:2.0:1788586888.886595:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612736 00010000:00010000:2.0:1788586888.887249:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 10 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.887283:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:2.0:1788586888.887294:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110612736:12345-192.168.203.1@tcp:103: 00010000:00010000:2.0:1788586888.887303:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.887308:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 10 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.887318:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 10 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.887331:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5800/0xfbc93bbea5fd9839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810668 expref: 10 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.887342:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.887379:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+9:2408:x1875469110612736:12345-192.168.203.1@tcp:103: Request processed in 88us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.887385:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 33 00010000:00010000:1.0:1788586888.888337:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586888.892765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586888.894267:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612864 00000100:00100000:2.0:1788586888.894316:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612864 00010000:00010000:2.0:1788586888.894377:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.894485:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:2.0:1788586888.894511:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+9:2408:x1875469110612864:12345-192.168.203.1@tcp:103: 00010000:00010000:2.0:1788586888.894539:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586888.894567:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894596:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894624:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810661 expref: 9 pid: 6516 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894653:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894662:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894678:0:8450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894686:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894692:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894708:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894714:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788586888.894719:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894727:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894763:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.894776:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586888.894849:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+8:2408:x1875469110612864:12345-192.168.203.1@tcp:103: Request processed in 355us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.894857:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 34 00010000:00010000:0.0:1788586888.895012:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.895022:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586888.895040:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fd9878 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586888.930940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586888.931009:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110612992 00000100:00100000:3.0:1788586888.931019:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110612992 00000100:00100000:3.0:1788586888.931086:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 198 00000100:00100000:3.0:1788586888.931097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+8:6177:x1875469110612992:12345-192.168.203.1@tcp:101: 00010000:00010000:3.0:1788586888.931113:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586888.931131:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd987f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8106d8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.931160:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd987f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106d8 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.931181:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd987f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106d8 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586888.931191:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd400, rc 0) 00000100:00100000:3.0:1788586888.931246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110612992:12345-192.168.203.1@tcp:101: Request processed in 151us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586888.931253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 198 00000100:00100000:3.0:1788586888.937778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586888.937837:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613120 00000100:00100000:0.0:1788586888.937848:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613120 00000100:00100000:0.0:1788586888.937948:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 199 00000100:00100000:0.0:1788586888.937959:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110613120:12345-192.168.203.1@tcp:501: 00000100:00100000:0.0:1788586888.938129:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110613120:12345-192.168.203.1@tcp:501: Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586888.938137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 199 00000100:00100000:3.0:1788586888.941134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586888.944245:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613248 00000100:00100000:2.0:1788586888.944260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613248 00000100:00100000:2.0:1788586888.944372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 200 00000100:00100000:2.0:1788586888.944383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110613248:12345-192.168.203.1@tcp:503: 00000100:00100000:2.0:1788586888.947984:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110613248:12345-192.168.203.1@tcp:503: Request processed in 3593us (6848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.947998:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 200 00000100:00100000:2.0:1788586888.952373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586888.952586:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613376 00000100:00100000:1.0:1788586888.952597:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613376 00000100:00100000:1.0:1788586888.952677:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 201 00000100:00100000:1.0:1788586888.952688:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6647:x1875469110613376:12345-192.168.203.1@tcp:502: 00000100:00100000:1.0:1788586888.952845:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6647:x1875469110613376:12345-192.168.203.1@tcp:502: Request processed in 158us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586888.952855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 201 00000100:00100000:3.0:1788586888.959152:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586888.959296:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613504 00000100:00100000:2.0:1788586888.959313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613504 00000100:00100000:2.0:1788586888.959368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 202 00000100:00100000:2.0:1788586888.959379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+9:6647:x1875469110613504:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788586888.959582:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+9:6647:x1875469110613504:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 204us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.959590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 202 00000100:00100000:0.0:1788586888.968076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586888.968143:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613632 00000100:00100000:2.0:1788586888.968153:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613632 00000100:00100000:2.0:1788586888.968216:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 203 00000100:00100000:2.0:1788586888.968228:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110613632:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586888.968243:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586888.968259:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7400/0xfbc93bbea5fd9886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8106df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.968286:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7400/0xfbc93bbea5fd9886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106df expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.968298:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7400/0xfbc93bbea5fd9886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106df expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586888.968307:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7400, rc 0) 00000100:00100000:2.0:1788586888.968365:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110613632:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 139us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586888.968372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 203 00000100:00100000:2.0:1788586888.971575:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586888.971626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613760 00000100:00100000:3.0:1788586888.971634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613760 00000100:00100000:3.0:1788586888.971699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 204 00000100:00100000:3.0:1788586888.971709:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110613760:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586888.971920:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110613760:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 211us (351us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788586888.971928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 204 00010000:00010000:0.0:1788586889.687696:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788586889.747216:0:10385:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffb879140 20000000:00000080:2.0:1788586889.747231:0:10385:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5bbcbbc800 uarg=0000000000000000 20000000:01000000:2.0:1788586889.747284:0:10385:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788586889.747290:0:10385:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788586889.747295:0:10385:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788586889.747876:0:10386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788586889.748037:0:10385:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788586889.754377:0:10385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788586889.755932:0:10385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788586889.755969:0:10385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788586889.755989:0:10385:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788586889.756010:0:10385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756028:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756036:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756042:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756049:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756058:0:10385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756065:0:10385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756207:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756237:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 9 pid: 6515 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586889.756253:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441280:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586889.756370:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756378:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 14 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586889.756386:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441408:0@lo:104: 00000100:00100000:2.0:1788586889.756444:0:10385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586889.756477:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756485:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 14 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586889.756493:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441536:0@lo:104: 00000100:00100000:2.0:1788586889.756516:0:10385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586889.756538:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756545:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 14 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586889.756552:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441664:0@lo:104: 00010000:00010000:2.0:1788586889.756572:0:10385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586889.756588:0:10385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 14 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586889.756596:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441792:0@lo:104: 00000100:00100000:2.0:1788586889.756613:0:10385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc8426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586889.758902:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788586889.759002:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586889.759024:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586889.759036:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441408 00000100:00100000:3.0:1788586889.759043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441408 00000100:00100000:3.0:1788586889.759575:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441536 00000100:00100000:3.0:1788586889.759580:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441536 00000100:00100000:3.0:1788586889.759595:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441664 00000100:00100000:3.0:1788586889.759597:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441664 00000100:00100000:3.0:1788586889.759605:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441792 00000100:00100000:3.0:1788586889.759607:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441792 00000100:00100000:3.0:1788586889.759630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788586889.759646:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:10385:x1875469127441408:12345-0@lo:104: 00010000:00010000:3.0:1788586889.759670:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.759727:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586889.759733:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:10385:x1875469127441408:12345-0@lo:104: Request processed in 97us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586889.759754:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788586889.759754:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441280:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586889.759764:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441408:0@lo:104: 00000100:00100000:3.0:1788586889.759770:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586889.759775:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:10385:x1875469127441536:12345-0@lo:104: 00010000:00010000:3.0:1788586889.759783:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.759829:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586889.759834:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:10385:x1875469127441536:12345-0@lo:104: Request processed in 60us (3318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586889.759840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586889.759890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586889.759901:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:10385:x1875469127441664:12345-0@lo:104: 00010000:00010000:3.0:1788586889.759909:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.759947:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788586889.759953:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:10385:x1875469127441664:12345-0@lo:104: Request processed in 57us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586889.759953:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441536:0@lo:104: 00000100:00100000:3.0:1788586889.759958:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586889.759961:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441664:0@lo:104: 00000100:00100000:3.0:1788586889.759970:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586889.759976:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:10385:x1875469127441792:12345-0@lo:104: 00010000:00010000:3.0:1788586889.759983:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760003:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788586889.760009:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760017:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318ae00 already unused, calling callback (ffffffffc13dec20) 00010000:00010000:3.0:1788586889.760018:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788586889.760023:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:10385:x1875469127441792:12345-0@lo:104: Request processed in 48us (998us total) trans 0 rc 0/0 10000000:00010000:1.0:1788586889.760026:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586889.760032:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788586889.760035:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586889.760041:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586889.760047:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788586889.760053:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788586889.760088:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760095:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586889.760118:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760125:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9728 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd972f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760136:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788586889.760139:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760150:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586889.760154:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760169:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586889.760185:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586889.760190:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788586889.760204:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760210:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586889.760225:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760231:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80031800/0xfbc93bbea5fd95ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95b5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760242:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586889.760245:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760251:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586889.760254:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760260:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586889.760266:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586889.760271:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788586889.760289:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760296:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586889.760301:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760307:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd95a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd95a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760317:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586889.760319:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586889.760321:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586889.760328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586889.760340:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127441920:0@lo:103: 00000100:00100000:1.0:1788586889.760371:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586889.760407:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127442048:0@lo:103: 00000100:00100000:1.0:1788586889.760454:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586889.760472:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586889.760478:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127442176:0@lo:103: 00000100:00100000:1.0:1788586889.760498:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586889.760527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127441920 00000100:00100000:1.0:1788586889.760530:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127441920 00010000:00010000:1.0:1788586889.760564:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 15 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586889.760591:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442048 00000100:00100000:1.0:1788586889.760594:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442048 00010000:00010000:1.0:1788586889.760604:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 16 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586889.760625:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442176 00000100:00100000:1.0:1788586889.760628:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442176 00010000:00010000:1.0:1788586889.760638:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 17 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586889.760649:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788586889.760655:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:3646:x1875469127441920:12345-0@lo:103: 00010000:00010000:1.0:1788586889.760665:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586889.760670:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 17 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760680:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 17 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760694:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecce00/0xfbc93bbea5fd972f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9728 expref: 17 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760706:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586889.760734:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:3646:x1875469127441920:12345-0@lo:103: Request processed in 78us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586889.760739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788586889.760752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788586889.760758:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:3648:x1875469127442048:12345-0@lo:103: 00010000:00010000:1.0:1788586889.760765:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586889.760769:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 15 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760777:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 15 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760792:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd95b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd95ae expref: 15 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760801:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586889.760827:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:3648:x1875469127442048:12345-0@lo:103: Request processed in 70us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586889.760833:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788586889.760845:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788586889.760850:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3648:x1875469127442176:12345-0@lo:103: 00010000:00010000:1.0:1788586889.760857:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586889.760862:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 13 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760869:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 13 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.760877:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586889.760895:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:3648:x1875469127442176:12345-0@lo:103: Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586889.760901:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788586889.761009:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127441920:0@lo:103: 00000100:00100000:1.0:1788586889.761033:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127442176:0@lo:103: 00000100:00100000:1.0:1788586889.761040:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127442048:0@lo:103: 00010000:00010000:0.0:1788586889.761223:0:10385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd95a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd95a0 expref: 12 pid: 6514 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586889.761233:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10385:1875469127441792:0@lo:104: 00010000:00010000:0.0:1788586889.761256:0:10385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.761903:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586889.761906:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586889.761909:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586889.763282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586889.763502:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110613888 00000100:00100000:3.0:1788586889.763510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110613888 00010000:00010000:3.0:1788586889.763544:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 10 pid: 6515 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.763726:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.763752:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788586889.763756:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.763764:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586889.763770:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586889.763775:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788586889.763819:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.763826:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586889.763852:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.763859:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc400/0xfbc93bbea5fd9602 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9609 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.763879:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586889.763881:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586889.763883:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586889.763891:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586889.763905:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127442304:0@lo:103: 00000100:00100000:1.0:1788586889.763948:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586889.763988:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442304 00000100:00100000:1.0:1788586889.764002:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442304 00010000:00010000:1.0:1788586889.764023:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 12 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586889.764049:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586889.764055:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:1.0:1788586889.764057:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:3647:x1875469127442304:12345-0@lo:103: 00000100:00100000:3.0:1788586889.764061:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110613888:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586889.764069:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586889.764069:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586889.764075:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 10 pid: 6515 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.764075:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 12 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.764087:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 10 pid: 6515 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.764098:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 12 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767517:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fd9847 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106a0 expref: 10 pid: 6515 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767540:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767549:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767570:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767589:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767595:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767602:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767608:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586889.767612:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.767620:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.767699:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd600/0xfbc93bbea5fd9609 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9602 expref: 12 pid: 6516 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586889.767742:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586889.767824:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:3647:x1875469127442304:12345-0@lo:103: Request processed in 3766us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586889.767833:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788586889.767917:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127442304:0@lo:103: 00010000:00010000:0.0:1788586889.767963:0:10385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586889.767977:0:10385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.769063:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.769076:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd988d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586889.769093:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586889.769149:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+9:2409:x1875469110613888:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 5086us (5875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586889.769166:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:2.0:1788586890.031764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586890.031842:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614016 00000100:00100000:0.0:1788586890.031852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614016 00000100:00100000:0.0:1788586890.031916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 205 00000100:00100000:0.0:1788586890.031928:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+9:6177:x1875469110614016:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586890.031945:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586890.031964:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8106e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.032007:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.032020:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.032029:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4a00, rc 0) 00000100:00100000:0.0:1788586890.032099:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110614016:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 174us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.032106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 205 00000100:00100000:0.0:1788586890.036271:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586890.036360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614144 00000100:00100000:1.0:1788586890.036370:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614144 00000100:00100000:1.0:1788586890.036450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 206 00000100:00100000:1.0:1788586890.036460:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110614144:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.036585:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110614144:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 126us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.036592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 206 00000100:00100000:2.0:1788586890.040404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586890.040711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614272 00000100:00100000:0.0:1788586890.040721:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614272 00000100:00100000:0.0:1788586890.040774:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 207 00000100:00100000:0.0:1788586890.040784:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110614272:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.040925:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6177:x1875469110614272:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 142us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.040936:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 207 00000100:00100000:2.0:1788586890.043385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586890.043514:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614400 00000100:00100000:0.0:1788586890.043524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614400 00000100:00100000:0.0:1788586890.043568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 208 00000100:00100000:0.0:1788586890.043579:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:6704:x1875469110614400:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788586890.043747:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:6704:x1875469110614400:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 169us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.043755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 208 00000100:00100000:0.0:1788586890.046039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586890.046170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614528 00000100:00100000:2.0:1788586890.046180:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614528 00000100:00100000:2.0:1788586890.046234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 209 00000100:00100000:2.0:1788586890.046245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6704:x1875469110614528:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788586890.046382:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:6704:x1875469110614528:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 138us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.046391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 209 00000100:00100000:3.0:1788586890.069186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127442432:0@lo:41: 00000100:00100000:3.0:1788586890.069265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.069375:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442432 00000100:00100000:1.0:1788586890.069383:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442432 00000100:00100000:1.0:1788586890.069464:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788586890.069481:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127442432:12345-0@lo:41: 00000004:00000024:1.0:1788586890.069514:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788586890.069563:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127442432:12345-0@lo:41: Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.069569:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788586890.069733:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127442432:0@lo:41: 10000000:01000000:0.0:1788586890.516473:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788586890.516481:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5bbcb3b800 from 48 10000000:01000000:0.0:1788586890.516487:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586890.516535:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.516547:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.516558:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586890.516581:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127442560:0@lo:101: 00000100:00100000:0.0:1788586890.516647:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.516698:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.520253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442560 00000100:00100000:2.0:1788586890.520267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442560 00000100:00100000:2.0:1788586890.520320:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788586890.520335:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+11:6518:x1875469127442560:12345-0@lo:101: 00010000:00010000:2.0:1788586890.520352:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586890.520371:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6c00/0xfbc93bbea5fd98a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd989b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.520397:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6c00/0xfbc93bbea5fd98a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd989b expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.520436:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa6c00/0xfbc93bbea5fd98a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd989b expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.520446:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6c00, rc 0) 00000100:00100000:2.0:1788586890.520519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127442560:12345-0@lo:101: Request processed in 190us (3872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.520525:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788586890.520628:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127442560:0@lo:101: 00010000:00010000:0.0:1788586890.520647:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.520666:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586890.520738:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127442688:0@lo:501: 00000100:00100000:0.0:1788586890.520770:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.520808:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.520967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442688 00000100:00100000:2.0:1788586890.520971:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442688 00000100:00100000:2.0:1788586890.521005:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788586890.521012:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127442688:12345-0@lo:501: 00000100:00100000:2.0:1788586890.521126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127442688:12345-0@lo:501: Request processed in 114us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.521133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788586890.521318:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127442688:0@lo:501: 00000100:00100000:0.0:1788586890.521347:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127442816:0@lo:503: 00000100:00100000:0.0:1788586890.521386:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.521408:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.521592:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442816 00000100:00100000:2.0:1788586890.521596:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442816 00000100:00100000:2.0:1788586890.521618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788586890.521624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127442816:12345-0@lo:503: 00000100:00100000:2.0:1788586890.521709:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127442816:12345-0@lo:503: Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.521716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788586890.521829:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127442816:0@lo:503: 00000100:00100000:3.0:1788586890.522248:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10426:1875469127442944:0@lo:502: 00000100:00100000:3.0:1788586890.522287:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.522320:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcab9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.522356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127442944 00000100:00100000:2.0:1788586890.522360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127442944 00000100:00100000:2.0:1788586890.522389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788586890.522396:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:10426:x1875469127442944:12345-0@lo:502: 00000100:00100000:2.0:1788586890.522512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:10426:x1875469127442944:12345-0@lo:502: Request processed in 115us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.522523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788586890.522630:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10426:1875469127442944:0@lo:502: 00000100:00100000:3.0:1788586890.522664:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10426:1875469127443072:0@lo:502: 00000100:00100000:3.0:1788586890.522695:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.522720:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90d8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.522761:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443072 00000100:00100000:0.0:1788586890.522765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443072 00000100:00100000:0.0:1788586890.522798:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788586890.522804:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:10426:x1875469127443072:12345-0@lo:502: 00000100:00100000:0.0:1788586890.522923:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:10426:x1875469127443072:12345-0@lo:502: Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.522930:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788586890.523112:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10426:1875469127443072:0@lo:502: 00000040:00080000:3.0:1788586890.523130:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788586890.523279:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788586890.523298:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586890.523306:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523316:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586890.523325:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788586890.523333:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788586890.523336:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788586890.523358:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523366:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523375:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586890.523387:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443200:0@lo:101: 00000100:00100000:0.0:1788586890.523413:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.523462:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.523475:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443200 00000100:00100000:0.0:1788586890.523479:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443200 00000100:00100000:0.0:1788586890.523501:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788586890.523506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+12:6518:x1875469127443200:12345-0@lo:101: 00010000:00010000:0.0:1788586890.523515:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586890.523525:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fd98b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98a9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523544:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fd98b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98a9 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523554:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fd98b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98a9 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523562:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5a00, rc 0) 00000100:00100000:0.0:1788586890.523588:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127443200:12345-0@lo:101: Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.523599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788586890.523629:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443200:0@lo:101: 00010000:00010000:0.0:1788586890.523638:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.523647:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586890.523684:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443328:0@lo:501: 00000100:00100000:0.0:1788586890.523707:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.523719:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.523730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443328 00000100:00100000:0.0:1788586890.523733:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443328 00000100:00100000:0.0:1788586890.523750:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788586890.523755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127443328:12345-0@lo:501: 00000100:00100000:0.0:1788586890.523835:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127443328:12345-0@lo:501: Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.523842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788586890.523868:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443328:0@lo:501: 00000100:00100000:0.0:1788586890.523888:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443456:0@lo:503: 00000100:00100000:0.0:1788586890.523919:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.523931:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.523941:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443456 00000100:00100000:0.0:1788586890.523944:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443456 00000100:00100000:0.0:1788586890.524150:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788586890.524167:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127443456:12345-0@lo:503: 00000100:00100000:0.0:1788586890.524246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127443456:12345-0@lo:503: Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.524253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788586890.524389:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443456:0@lo:503: 00000100:00100000:3.0:1788586890.524749:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10427:1875469127443584:0@lo:502: 00000100:00100000:3.0:1788586890.524788:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.524815:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90d8d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.524856:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443584 00000100:00100000:0.0:1788586890.524861:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443584 00000100:00100000:0.0:1788586890.524923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788586890.524930:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:10427:x1875469127443584:12345-0@lo:502: 00000100:00100000:0.0:1788586890.525021:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:10427:x1875469127443584:12345-0@lo:502: Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.525036:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788586890.525094:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10427:1875469127443584:0@lo:502: 00000020:01000000:3.0:1788586890.525116:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586890.525124:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586890.525126:0:10427:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788586890.525131:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788586890.525161:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10427:1875469127443712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.525195:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.525625:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcab9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.525807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443712 00000100:00100000:2.0:1788586890.525813:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443712 00000100:00100000:2.0:1788586890.525839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788586890.525846:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:10427:x1875469127443712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.526177:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:10427:x1875469127443712:12345-0@lo:502:llog_process_th.0 Request processed in 331us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.526185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788586890.535538:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10427:1875469127443712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586890.535593:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586890.535601:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586890.535610:0:10427:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788586890.535616:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788586890.536143:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788586890.536182:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788586890.536194:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.536204:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586890.536213:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788586890.536215:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bbcb3b800 from 4 10000000:01000000:1.0:1788586890.536218:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788586890.536253:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.536260:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.536269:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.536290:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.536355:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.536403:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.537540:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443840 00000100:00100000:0.0:1788586890.537551:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443840 00000100:00100000:0.0:1788586890.537607:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788586890.537618:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+13:6518:x1875469127443840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586890.537634:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586890.537649:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.537672:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.537683:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.537691:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788586890.537755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127443840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.537762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788586890.543996:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586890.544035:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.544049:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586890.544134:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.544205:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.544245:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90d8d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.544300:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127443968 00000100:00100000:1.0:1788586890.544308:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127443968 00000100:00100000:0.0:1788586890.546748:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788586890.548565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127443968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.548728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127443968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.548736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788586890.551322:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127443968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.551386:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.552505:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.552558:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90d8d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.552686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444096 00000100:00100000:1.0:1788586890.552694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444096 00000100:00100000:1.0:1788586890.552749:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788586890.552758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127444096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.553215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127444096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 458us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.553224:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788586890.553277:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.556883:0:10432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10432:1875469127444224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.557184:0:10432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.557228:0:10432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcab9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.557280:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444224 00000100:00100000:0.0:1788586890.557286:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444224 00000100:00100000:0.0:1788586890.557333:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788586890.557343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:10432:x1875469127444224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.557502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:10432:x1875469127444224:12345-0@lo:502:llog_process_th.0 Request processed in 159us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.557510:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788586890.557716:0:10432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10432:1875469127444224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586890.557746:0:10432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586890.557756:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586890.557758:0:10432:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788586890.557765:0:10432:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5bbcb3b800 00000020:00000080:3.0:1788586890.557768:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788586890.558034:0:10432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10432:1875469127444352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.558149:0:10432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.558191:0:10432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbacd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.558866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444352 00000100:00100000:2.0:1788586890.558873:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444352 00000100:00100000:2.0:1788586890.558907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788586890.558915:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:10432:x1875469127444352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.559544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:10432:x1875469127444352:12345-0@lo:502:llog_process_th.0 Request processed in 627us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.559552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788586890.561111:0:10432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10432:1875469127444352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.561162:0:10432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586890.561172:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.561174:0:10432:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788586890.561182:0:10432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788586890.567031:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788586890.567071:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586890.567083:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567096:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586890.567106:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788586890.567109:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5bae583000 from 48 10000000:01000000:1.0:1788586890.567112:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586890.567150:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567168:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567178:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.567218:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.567282:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.567325:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.567346:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444480 00000100:00100000:1.0:1788586890.567352:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444480 00000100:00100000:1.0:1788586890.567395:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788586890.567404:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+14:6518:x1875469127444480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.567433:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586890.567445:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8318ba00/0xfbc93bbea5fd98cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567469:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8318ba00/0xfbc93bbea5fd98cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98c5 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567481:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8318ba00/0xfbc93bbea5fd98cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98c5 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567489:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318ba00, rc 0) 00000100:00100000:1.0:1788586890.567525:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127444480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.567531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788586890.567574:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.567587:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.567596:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.567655:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.567678:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.567690:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.567701:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444608 00000100:00100000:1.0:1788586890.567704:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444608 00000100:00100000:1.0:1788586890.567725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788586890.567731:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127444608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.567835:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127444608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.567842:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788586890.567871:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.567910:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.567946:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.567958:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.567969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444736 00000100:00100000:1.0:1788586890.567972:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444736 00000100:00100000:1.0:1788586890.567990:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788586890.567995:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127444736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.568075:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127444736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.568082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788586890.568121:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127444736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.568304:0:10435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10435:1875469127444864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.568340:0:10435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.568357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444864 00000100:00100000:1.0:1788586890.568360:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444864 00000100:00100000:1.0:1788586890.568379:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788586890.568385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:10435:x1875469127444864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.568471:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:10435:x1875469127444864:12345-0@lo:502:llog_process_th.0 Request processed in 86us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.568478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788586890.568505:0:10435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.568515:0:10435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10435:1875469127444864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.568546:0:10435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10435:1875469127444992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.568577:0:10435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.568595:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127444992 00000100:00100000:1.0:1788586890.568599:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127444992 00000100:00100000:1.0:1788586890.568618:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788586890.568623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:10435:x1875469127444992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.568673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:10435:x1875469127444992:12345-0@lo:502:llog_process_th.0 Request processed in 49us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.568679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788586890.568702:0:10435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.568712:0:10435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10435:1875469127444992:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788586890.568727:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788586890.569181:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788586890.569197:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586890.569205:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.569215:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586890.569223:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788586890.569226:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788586890.569228:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586890.569248:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.569256:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.569265:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586890.569278:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.569305:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.569326:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac480 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.570143:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445120 00000100:00100000:1.0:1788586890.570162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445120 00000100:00100000:1.0:1788586890.570203:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788586890.570217:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+15:6518:x1875469127445120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.570234:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586890.570248:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8318b200/0xfbc93bbea5fd98da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98d3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.570270:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8318b200/0xfbc93bbea5fd98da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98d3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.570281:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8318b200/0xfbc93bbea5fd98da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98d3 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.570289:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318b200, rc 0) 00000100:00100000:1.0:1788586890.570336:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127445120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.570343:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788586890.570382:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.570397:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.570405:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.570472:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.570503:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.570519:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.570530:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445248 00000100:00100000:1.0:1788586890.570533:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445248 00000100:00100000:1.0:1788586890.570554:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788586890.570567:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127445248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.570662:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127445248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.570669:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788586890.570693:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.570715:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.570745:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.570756:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.570767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445376 00000100:00100000:1.0:1788586890.570771:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445376 00000100:00100000:1.0:1788586890.570789:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788586890.570794:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127445376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.570863:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127445376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.570869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788586890.572223:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.572452:0:10436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10436:1875469127445504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.572507:0:10436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.572534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445504 00000100:00100000:1.0:1788586890.572539:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445504 00000100:00100000:1.0:1788586890.572572:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788586890.572581:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10436:x1875469127445504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.572679:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10436:x1875469127445504:12345-0@lo:502:llog_process_th.0 Request processed in 99us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.572695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788586890.572735:0:10436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.572749:0:10436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10436:1875469127445504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586890.572771:0:10436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586890.572779:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586890.572781:0:10436:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788586890.572786:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788586890.572804:0:10436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10436:1875469127445632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.572838:0:10436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.572858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445632 00000100:00100000:1.0:1788586890.572862:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445632 00000100:00100000:2.0:1788586890.572919:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788586890.572929:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10436:x1875469127445632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.573127:0:10436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90d8d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.573328:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:10436:x1875469127445632:12345-0@lo:502:llog_process_th.0 Request processed in 400us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.573336:0:10436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10436:1875469127445632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.573339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000020:01000000:1.0:1788586890.573360:0:10436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586890.573366:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586890.573368:0:10436:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788586890.573373:0:10436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788586890.573459:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788586890.573484:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788586890.573494:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573506:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586890.573515:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586890.573518:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bae583000 from 4 10000000:01000000:2.0:1788586890.573521:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586890.573546:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573554:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573629:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.573645:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.573676:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.573704:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb5b2fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.573718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445760 00000100:00100000:2.0:1788586890.573722:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445760 00000100:00100000:2.0:1788586890.573750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788586890.573757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+16:6518:x1875469127445760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.573766:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586890.573778:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573811:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573822:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573831:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6400, rc 0) 00000100:00100000:2.0:1788586890.573863:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127445760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.573869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788586890.573902:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.573915:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.573924:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.573972:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.574436:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.574467:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb5b2fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.574483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127445888 00000100:00100000:2.0:1788586890.574487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127445888 00000100:00100000:2.0:1788586890.574513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788586890.574519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127445888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.574632:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127445888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.574648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788586890.574692:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127445888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.574723:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.574763:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.574781:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb5b2fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.574797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446016 00000100:00100000:2.0:1788586890.574801:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446016 00000100:00100000:2.0:1788586890.574826:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788586890.574832:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127446016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.574903:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127446016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.574909:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788586890.574959:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.575337:0:10439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10439:1875469127446144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.575374:0:10439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.575493:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446144 00000100:00100000:2.0:1788586890.575498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446144 00000100:00100000:2.0:1788586890.575522:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788586890.575529:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10439:x1875469127446144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.575601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10439:x1875469127446144:12345-0@lo:502:llog_process_th.0 Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.575609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788586890.575647:0:10439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb5b2f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.575663:0:10439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10439:1875469127446144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.575692:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586890.575701:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.575703:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788586890.575714:0:10439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5bae583000 00000020:00000080:2.0:1788586890.575717:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788586890.575875:0:10439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10439:1875469127446272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.575911:0:10439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.575932:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446272 00000100:00100000:2.0:1788586890.575935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446272 00000100:00100000:2.0:1788586890.575956:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788586890.575962:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10439:x1875469127446272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.576045:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:10439:x1875469127446272:12345-0@lo:502:llog_process_th.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.576052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788586890.576088:0:10439:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.576100:0:10439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10439:1875469127446272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.576118:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586890.576123:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.576125:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788586890.576129:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788586890.576183:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788586890.576201:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586890.576209:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.576220:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586890.576239:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788586890.576241:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5baaa5e000 from 48 10000000:01000000:2.0:1788586890.576244:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788586890.576266:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.576275:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.576284:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.576297:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.576323:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.576344:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.576370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446400 00000100:00100000:3.0:1788586890.576375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446400 00000100:00100000:3.0:1788586890.577060:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788586890.577175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+17:6518:x1875469127446400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586890.577194:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586890.577208:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd98f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.577230:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd98f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98ef expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.577241:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd98f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98ef expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.577249:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd200, rc 0) 00000100:00100000:3.0:1788586890.577683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127446400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 612us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.577690:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788586890.580711:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.580741:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.580754:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.582754:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.583174:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.583214:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.583249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446528 00000100:00100000:2.0:1788586890.583256:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446528 00000100:00100000:2.0:1788586890.583306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788586890.583314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127446528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.584724:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127446528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1407us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.584734:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788586890.584787:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.585135:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.585185:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.585211:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.585226:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446656 00000100:00100000:2.0:1788586890.585230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446656 00000100:00100000:2.0:1788586890.585258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788586890.585264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127446656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.585342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127446656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.585349:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788586890.585382:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.587879:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10441:1875469127446784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.587952:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.587992:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.588040:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446784 00000100:00100000:3.0:1788586890.588046:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446784 00000100:00100000:3.0:1788586890.588100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788586890.588110:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10441:x1875469127446784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.588235:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10441:x1875469127446784:12345-0@lo:502:llog_process_th.0 Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.588243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788586890.588291:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10441:1875469127446784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.588328:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82295500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10441:1875469127446912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.588357:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586890.588378:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127446912 00000100:00100000:3.0:1788586890.588382:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127446912 00000100:00100000:3.0:1788586890.588437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788586890.588450:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10441:x1875469127446912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.588502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:10441:x1875469127446912:12345-0@lo:502:llog_process_th.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.588508:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788586890.588539:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.588550:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82295500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10441:1875469127446912:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788586890.588567:0:10441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788586890.588931:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788586890.588951:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788586890.588962:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.588982:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586890.588992:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788586890.588994:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788586890.588997:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788586890.589020:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.589028:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.589037:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.589051:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.589144:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.589210:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.589243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447040 00000100:00100000:3.0:1788586890.589248:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447040 00000100:00100000:3.0:1788586890.589308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788586890.589316:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+18:6518:x1875469127447040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586890.589324:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586890.589336:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd98fd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.589355:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98fd expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.589365:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98fd expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.589373:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecc800, rc 0) 00000100:00100000:3.0:1788586890.589436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127447040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.589442:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788586890.589660:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.589675:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.589685:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.589736:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.589760:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.589786:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.589798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447168 00000100:00100000:2.0:1788586890.589801:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447168 00000100:00100000:2.0:1788586890.589822:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788586890.589828:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127447168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.589916:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127447168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.589923:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788586890.589953:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.589977:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.590009:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.590022:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.590032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447296 00000100:00100000:2.0:1788586890.590035:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447296 00000100:00100000:2.0:1788586890.590056:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788586890.590062:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127447296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.590729:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127447296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 665us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.590737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788586890.590778:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.590946:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10443:1875469127447424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.590980:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.591009:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.591058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447424 00000100:00100000:3.0:1788586890.591063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447424 00000100:00100000:3.0:1788586890.591179:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788586890.591186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:10443:x1875469127447424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.591262:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:10443:x1875469127447424:12345-0@lo:502:llog_process_th.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.591268:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788586890.591673:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10443:1875469127447424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.591695:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586890.591708:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.591710:0:10443:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788586890.591718:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788586890.591738:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10443:1875469127447552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.591769:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.591790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447552 00000100:00100000:2.0:1788586890.591794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447552 00000100:00100000:2.0:1788586890.591822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788586890.591827:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:10443:x1875469127447552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.591889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:10443:x1875469127447552:12345-0@lo:502:llog_process_th.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.591895:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788586890.591925:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.591936:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10443:1875469127447552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.591953:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586890.591957:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.591959:0:10443:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788586890.591963:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788586890.592007:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788586890.592021:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788586890.592029:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.592039:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586890.592047:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586890.592049:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5baaa5e000 from 4 10000000:01000000:2.0:1788586890.592052:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586890.592809:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.592820:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.592830:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.592847:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.592880:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.592909:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.594211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447680 00000100:00100000:0.0:1788586890.594220:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447680 00000100:00100000:0.0:1788586890.594330:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788586890.594461:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:6518:x1875469127447680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586890.594476:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586890.594490:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd990b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.594516:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.594526:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.594534:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5200, rc 0) 00000100:00100000:0.0:1788586890.594587:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127447680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.594602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788586890.595224:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.595242:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.595252:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.595321:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.595355:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.596175:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.596556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447808 00000100:00100000:0.0:1788586890.596563:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447808 00000100:00100000:0.0:1788586890.596612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788586890.596621:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127447808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.596749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127447808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.596758:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788586890.596841:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.596884:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.596932:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.596964:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.597228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127447936 00000100:00100000:3.0:1788586890.597233:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127447936 00000100:00100000:3.0:1788586890.597268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788586890.597276:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127447936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.597364:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127447936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.597371:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788586890.598549:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127447936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.599601:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10445:1875469127448064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.599667:0:10445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.599711:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b84f580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.599783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448064 00000100:00100000:3.0:1788586890.599789:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448064 00000100:00100000:3.0:1788586890.599833:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788586890.599841:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:10445:x1875469127448064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.599949:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:10445:x1875469127448064:12345-0@lo:502:llog_process_th.0 Request processed in 108us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.599957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788586890.600176:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10445:1875469127448064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788586890.600202:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586890.600211:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586890.600214:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788586890.600219:0:10445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5baaa5e000 00000020:00000080:0.0:1788586890.600222:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788586890.600356:0:10445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10445:1875469127448192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.600391:0:10445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.600441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448192 00000100:00100000:0.0:1788586890.600445:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448192 00000100:00100000:0.0:1788586890.602493:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788586890.602509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:10445:x1875469127448192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.602645:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:10445:x1875469127448192:12345-0@lo:502:llog_process_th.0 Request processed in 142us (2253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.602661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788586890.602707:0:10445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b892ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.602727:0:10445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10445:1875469127448192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788586890.602756:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586890.602762:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586890.602765:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788586890.602769:0:10445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788586890.603238:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788586890.603262:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586890.603273:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.603360:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586890.603370:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788586890.603373:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5b86e73000 from 48 10000000:01000000:1.0:1788586890.603376:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586890.603432:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.603441:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.603451:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.603470:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.603510:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.603542:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.603557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448320 00000100:00100000:0.0:1788586890.603564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448320 00000100:00100000:0.0:1788586890.603609:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788586890.603616:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127448320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586890.603626:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586890.603638:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9919 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.603659:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9919 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.603670:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9919 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.603678:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4400, rc 0) 00000100:00100000:0.0:1788586890.603710:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127448320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.603716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788586890.603784:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.603796:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.603805:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.603853:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.603876:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.603897:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.603964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448448 00000100:00100000:0.0:1788586890.603969:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448448 00000100:00100000:0.0:1788586890.603998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788586890.604011:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127448448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.604193:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127448448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.604200:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788586890.604262:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.604288:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.604324:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.604342:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788586890.604504:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448576 00000100:00100000:0.0:1788586890.604509:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448576 00000100:00100000:0.0:1788586890.604536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788586890.604543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127448576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.604611:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127448576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586890.604618:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788586890.605190:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.605671:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10446:1875469127448704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.605716:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.605794:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.605835:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448704 00000100:00100000:1.0:1788586890.605839:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448704 00000100:00100000:1.0:1788586890.605872:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788586890.605879:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10446:x1875469127448704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.605971:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10446:x1875469127448704:12345-0@lo:502:llog_process_th.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.605978:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788586890.606178:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10446:1875469127448704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.606216:0:10446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10446:1875469127448832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586890.606248:0:10446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.606273:0:10446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.606364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448832 00000100:00100000:1.0:1788586890.606368:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448832 00000100:00100000:1.0:1788586890.606519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788586890.606527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10446:x1875469127448832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.606797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:10446:x1875469127448832:12345-0@lo:502:llog_process_th.0 Request processed in 270us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.606804:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788586890.608931:0:10446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10446:1875469127448832:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788586890.608991:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788586890.609253:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788586890.609273:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788586890.609283:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.609294:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586890.609303:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788586890.609306:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788586890.609308:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788586890.609339:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.609357:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.609366:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.609386:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.611286:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.611338:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.611852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127448960 00000100:00100000:2.0:1788586890.611866:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127448960 00000100:00100000:2.0:1788586890.611968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788586890.611977:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127448960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.611993:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586890.612011:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7c00/0xfbc93bbea5fd992e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9927 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.612037:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7c00/0xfbc93bbea5fd992e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9927 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.612049:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7c00/0xfbc93bbea5fd992e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9927 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.612058:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7c00, rc 0) 00000100:00100000:2.0:1788586890.612105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127448960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.612113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788586890.612244:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127448960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.612261:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.612271:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586890.612342:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.612372:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.612397:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae780 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.612411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449088 00000100:00100000:2.0:1788586890.612452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449088 00000100:00100000:2.0:1788586890.612478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788586890.612484:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127449088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.612583:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127449088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.612591:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788586890.612628:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.612654:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.612691:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.612707:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae780 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.612718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449216 00000100:00100000:2.0:1788586890.612721:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449216 00000100:00100000:2.0:1788586890.612740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788586890.612745:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127449216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.612816:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127449216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.612821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788586890.612858:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586890.617820:0:10449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10449:1875469127449344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.617892:0:10449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.617932:0:10449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.617977:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449344 00000100:00100000:3.0:1788586890.617985:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449344 00000100:00100000:3.0:1788586890.618167:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788586890.618178:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:10449:x1875469127449344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.618298:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:10449:x1875469127449344:12345-0@lo:502:llog_process_th.0 Request processed in 120us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.618312:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788586890.618587:0:10449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10449:1875469127449344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.618617:0:10449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586890.618626:0:10449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.618633:0:10449:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788586890.618643:0:10449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788586890.618664:0:10449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10449:1875469127449472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586890.618699:0:10449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586890.618728:0:10449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbfaae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.618862:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449472 00000100:00100000:3.0:1788586890.618867:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449472 00000100:00100000:3.0:1788586890.618900:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788586890.618909:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:10449:x1875469127449472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586890.618982:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:10449:x1875469127449472:12345-0@lo:502:llog_process_th.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.618989:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788586890.619509:0:10449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10449:1875469127449472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586890.619531:0:10449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586890.619536:0:10449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586890.619538:0:10449:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788586890.619544:0:10449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788586890.620189:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788586890.620212:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788586890.620222:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.620244:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586890.620255:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788586890.620257:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5b86e73000 from 4 10000000:01000000:0.0:1788586890.620260:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788586890.620359:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.620367:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.620376:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586890.620717:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.620768:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.620921:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586890.620958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449600 00000100:00100000:2.0:1788586890.620965:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449600 00000100:00100000:2.0:1788586890.621045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788586890.621055:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127449600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586890.621066:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586890.621190:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9935 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.621214:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.621225:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586890.621234:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7800, rc 0) 00000100:00100000:2.0:1788586890.621322:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127449600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586890.621329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788586890.621516:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586890.621531:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586890.621542:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586890.621605:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586890.621633:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586890.621778:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586890.621831:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449728 00000100:00100000:3.0:1788586890.621836:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449728 00000100:00100000:3.0:1788586890.621861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788586890.621868:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127449728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586890.621985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127449728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586890.621992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788586890.626732:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.626793:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.626980:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.627015:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.627034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449856 00000100:00100000:1.0:1788586890.627040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449856 00000100:00100000:1.0:1788586890.627081:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788586890.627090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127449856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.627205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127449856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.627212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788586890.627258:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127449856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.627451:0:10451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10451:1875469127449984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.628301:0:10451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.628329:0:10451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb06e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.630999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127449984 00000100:00100000:1.0:1788586890.631011:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127449984 00000100:00100000:1.0:1788586890.631064:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788586890.631074:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10451:x1875469127449984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.631264:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10451:x1875469127449984:12345-0@lo:502:llog_process_th.0 Request processed in 191us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.631272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788586890.631339:0:10451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10451:1875469127449984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586890.631376:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586890.631386:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586890.631388:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788586890.631396:0:10451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5b86e73000 00000020:00000080:1.0:1788586890.631398:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788586890.632520:0:10451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10451:1875469127450112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.632580:0:10451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.632636:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450112 00000100:00100000:1.0:1788586890.632643:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450112 00000100:00100000:1.0:1788586890.632682:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788586890.632690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10451:x1875469127450112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586890.632782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:10451:x1875469127450112:12345-0@lo:502:llog_process_th.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.632791:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788586890.632854:0:10451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.632874:0:10451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:10451:1875469127450112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586890.632901:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586890.632907:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586890.632915:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788586890.632920:0:10451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788586890.632988:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788586890.633011:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586890.633020:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633031:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586890.633040:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788586890.633042:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f5bb05e3380 from 1 10000000:01000000:1.0:1788586890.633045:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788586890.633068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633076:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633085:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.633097:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127450240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.633124:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.633138:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.633163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450240 00000100:00100000:1.0:1788586890.633167:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450240 00000100:00100000:1.0:1788586890.633203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788586890.633212:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127450240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.633220:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586890.633239:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd994a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9943 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633262:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd994a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9943 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633272:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd994a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9943 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633280:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318be00, rc 0) 00000100:00100000:1.0:1788586890.633311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127450240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586890.633318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788586890.633353:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127450240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586890.633367:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633376:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586890.633442:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127450368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.633469:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586890.633485:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586890.633496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450368 00000100:00100000:1.0:1788586890.633500:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450368 00000100:00100000:1.0:1788586890.633520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788586890.633527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127450368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586890.633590:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127450368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788586890.633602:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788586890.633632:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127450368:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788586890.633650:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788586890.633655:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586890.633662:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586890.708648:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586891.377118:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586891.377184:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586891.377225:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586891.377383:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614784 00000100:00100000:3.0:1788586891.377392:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614784 00000100:00100000:1.0:1788586891.377456:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614656 00000100:00100000:1.0:1788586891.377462:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614656 00000100:00100000:3.0:1788586891.377493:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:1.0:1788586891.377502:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 272 00000100:00100000:3.0:1788586891.377507:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110614784:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586891.377516:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110614656:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586891.377580:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110614784:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 78us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586891.377588:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:0.0:1788586891.377603:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615040 00000100:00100000:0.0:1788586891.377609:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615040 00000100:00100000:0.0:1788586891.377649:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:0.0:1788586891.377658:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110615040:12345-192.168.203.1@tcp:400:kworker.0 00000100:00080000:2.0:1788586891.377712:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788586891.377719:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586891.380796:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110614656:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 3275us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586891.380811:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 272 00000100:00100000:3.0:1788586891.384493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586891.384605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586891.384638:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615168 00000100:00100000:3.0:1788586891.384658:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615168 00000100:00100000:3.0:1788586891.384716:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788586891.384727:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110615168:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586891.384794:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110615168:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586891.384802:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00080000:3.0:1788586891.384825:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788586891.387127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110614912 00000100:00100000:1.0:1788586891.387140:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110614912 00000100:00100000:1.0:1788586891.387219:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:1.0:1788586891.387229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110614912:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586891.387297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110614912:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 69us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586891.387304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:0.0:1788586891.389222:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110615040:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 11558us (12029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586891.389234:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00080000:3.0:1788586891.393122:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788586891.733616:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586892.628966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788586892.628989:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127450496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586892.629073:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586892.629131:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450496 00000100:00100000:1.0:1788586892.629150:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450496 00000100:00100000:1.0:1788586892.629203:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586892.629210:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127450496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788586892.629236:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586892.629291:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127450496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.629297:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788586892.629316:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788586892.629460:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127450496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586892.629480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127450496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586892.629623:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127450624:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.629774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.629865:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127451136:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.629891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.629911:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127451648:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.631959:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.632030:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788586892.632042:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127451008:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.632091:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.632110:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127451520:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.632133:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.632159:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127452032:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.632178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.632248:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127450752:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.632272:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.632290:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127451264:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.632320:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.632610:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127451776:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633007:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.633033:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788586892.633040:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127450880:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633065:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.633082:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127451392:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633101:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.633115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127451904:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633132:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586892.633173:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450624 00000100:00100000:3.0:1788586892.633180:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450624 00000100:00100000:3.0:1788586892.633220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788586892.633228:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127450624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633280:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127450624:12345-0@lo:400:kworker.0 Request processed in 53us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586892.633287:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788586892.633499:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451008 00000100:00100000:1.0:1788586892.633504:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451008 00000100:00100000:1.0:1788586892.633528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450752 00000100:00100000:1.0:1788586892.633531:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450752 00000100:00100000:1.0:1788586892.633542:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451264 00000100:00100000:1.0:1788586892.633544:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451264 00000100:00100000:1.0:1788586892.633564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451776 00000100:00100000:1.0:1788586892.633567:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451776 00000100:00100000:1.0:1788586892.633578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451392 00000100:00100000:1.0:1788586892.633580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451392 00000100:00100000:1.0:1788586892.633591:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451904 00000100:00100000:1.0:1788586892.633594:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451904 00000100:00100000:1.0:1788586892.633612:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788586892.633621:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127451008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633625:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451648 00000100:00100000:1.0:1788586892.633664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127451008:12345-0@lo:400:kworker.0 Request processed in 45us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.633670:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788586892.633683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788586892.633689:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127450752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633704:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451648 00000100:00100000:3.0:1788586892.633746:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451520 00000100:00100000:1.0:1788586892.633747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127450752:12345-0@lo:400:kworker.0 Request processed in 56us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586892.633750:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451520 00000100:00100000:1.0:1788586892.633760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788586892.633770:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452032 00000100:00100000:3.0:1788586892.633774:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452032 00000100:00100000:1.0:1788586892.633779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586892.633787:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127451264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.633811:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127451264:12345-0@lo:400:kworker.0 Request processed in 26us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.633817:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586892.633826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788586892.633831:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127451776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.633855:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127451776:12345-0@lo:400:kworker.0 Request processed in 24us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.633862:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788586892.633871:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788586892.633876:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788586892.633887:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127451392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633892:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127451648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.633916:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127451392:12345-0@lo:400:kworker.0 Request processed in 30us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.633923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788586892.633938:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788586892.633943:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127451648:12345-0@lo:400:kworker.0 Request processed in 55us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.633948:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127451904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.633955:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788586892.633983:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127451904:12345-0@lo:400:kworker.0 Request processed in 37us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586892.633984:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586892.633995:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788586892.633997:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127451520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.634018:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127451136 00000100:00100000:1.0:1788586892.634023:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127451136 00000100:00100000:3.0:1788586892.634034:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127451520:12345-0@lo:400:kworker.0 Request processed in 40us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586892.634042:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586892.634057:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586892.634064:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127452032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.634073:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127450880 00000100:00100000:1.0:1788586892.634079:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127450880 00000100:00100000:1.0:1788586892.634095:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788586892.634104:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127451136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.634110:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127452032:12345-0@lo:400:kworker.0 Request processed in 45us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586892.634118:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788586892.634157:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127451136:12345-0@lo:400:kworker.0 Request processed in 55us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.634164:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788586892.634181:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586892.634188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127450880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.634214:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127450880:12345-0@lo:400:kworker.0 Request processed in 28us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.634220:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788586892.634238:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586892.634242:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788586892.634245:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788586892.634372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586892.634407:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127450880:0@lo:400:kworker.0 00010000:00080000:1.0:1788586892.634448:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca7a300 x1875469127451392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586892.634459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127451392:0@lo:400:kworker.0 00010000:00080000:1.0:1788586892.634471:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf9180 x1875469127451904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586892.634479:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127451904:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.634484:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127452160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586892.634495:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127450752:0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.634508:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127451264:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.634521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586892.634534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127451776:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.634559:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127451008:0@lo:400:kworker.0 00010000:00080000:3.0:1788586892.634576:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca79c00 x1875469127451520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586892.634586:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127451520:0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.634586:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452160 00000100:00100000:1.0:1788586892.634593:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452160 00010000:00080000:3.0:1788586892.634601:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf9f80 x1875469127452032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586892.634610:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127452032:0@lo:400:kworker.0 00000100:00100000:3.0:1788586892.634625:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127450624:0@lo:400:kworker.0 00000100:00100000:1.0:1788586892.634626:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788586892.634634:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127452160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586892.634649:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586892.634680:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127452160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586892.634685:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788586892.634709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127451136:0@lo:400:kworker.0 00010000:00080000:3.0:1788586892.634718:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8e00 x1875469127451648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586892.634727:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127451648:0@lo:400:kworker.0 00010000:00080000:3.0:1788586892.634754:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372b480 x1875469127452160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586892.634767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127452160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788586892.760438:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586893.661206:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127452288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586893.661286:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586893.661360:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586893.661368:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127452416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586893.661392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586893.661487:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127452544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586893.661514:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586893.661549:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452288 00000100:00100000:1.0:1788586893.661556:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452288 00000100:00100000:1.0:1788586893.661592:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452544 00000100:00100000:1.0:1788586893.661595:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452544 00000100:00100000:1.0:1788586893.661611:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788586893.661619:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127452288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788586893.661649:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586893.661692:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127452288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586893.661714:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788586893.661731:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788586893.661737:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127452544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788586893.661761:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586893.661792:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127452544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586893.661798:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788586893.661831:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8310b100 x1875469127452288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586893.661849:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127452288:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788586893.661875:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372aa00 x1875469127452544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586893.661885:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127452544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586893.662075:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452416 00000100:00100000:3.0:1788586893.662079:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452416 00000100:00100000:3.0:1788586893.662114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788586893.662121:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127452416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788586893.662152:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586893.662201:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127452416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586893.662208:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788586893.662272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127452416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788586893.783339:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586894.805149:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586895.148749:0:10695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788586895.188759:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586895.188781:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127452672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586895.188852:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586895.189046:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452672 00000100:00100000:3.0:1788586895.189055:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452672 00000100:00100000:3.0:1788586895.189109:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788586895.189131:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127452672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586895.189169:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586895.189223:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127452672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586895.189230:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788586895.189263:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127452672:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788586895.828919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586896.487235:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586896.487277:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586896.487306:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586896.487331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586896.487355:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586896.487378:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615552 00000100:00100000:1.0:1788586896.487388:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615552 00000100:00100000:3.0:1788586896.487399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615424 00000100:00100000:3.0:1788586896.487406:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615424 00000100:00100000:1.0:1788586896.487474:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:0.0:1788586896.487524:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615808 00000100:00100000:0.0:1788586896.487528:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615808 00000100:00100000:0.0:1788586896.487561:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615680 00000100:00100000:0.0:1788586896.487563:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615680 00000100:00100000:0.0:1788586896.487583:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:0.0:1788586896.487590:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110615808:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586896.487671:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110615808:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586896.487677:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:0.0:1788586896.487693:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:0.0:1788586896.487699:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110615680:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586896.487723:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110615680:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586896.487728:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00080000:0.0:1788586896.487754:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586896.487881:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110615552:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586896.487980:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110615552:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 498us (702us total) trans 0 rc 0/0 00000100:00080000:0.0:1788586896.488011:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586896.488013:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586896.488015:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788586896.488192:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615296 00000100:00100000:2.0:1788586896.488197:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615296 00000100:00100000:2.0:1788586896.488224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 274 00000100:00100000:2.0:1788586896.488230:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:2407:x1875469110615296:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586896.488259:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:2407:x1875469110615296:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 29us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586896.488264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 274 00000100:00100000:3.0:1788586896.494710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 62 00000100:00100000:1.0:1788586896.494734:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:3.0:1788586896.494736:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2407:x1875469110615424:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586896.498589:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2407:x1875469110615424:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 3853us (11243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586896.498603:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 62 00010000:00010000:3.0:1788586896.853370:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586897.749097:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127452800:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749227:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127453312:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749252:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749271:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127453824:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749292:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127454336:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749326:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749358:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788586897.749364:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127452928:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749405:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127453440:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749448:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127453952:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749478:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749491:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127454464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586897.749518:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749546:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127453056:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749567:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749584:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127453568:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749602:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749635:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749647:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788586897.749652:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127453184:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749671:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749681:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127453696:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127454208:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586897.749760:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453824 00000100:00100000:2.0:1788586897.749767:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453824 00000100:00100000:2.0:1788586897.749811:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454336 00000100:00100000:2.0:1788586897.749819:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454336 00000100:00100000:2.0:1788586897.749835:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453696 00000100:00100000:2.0:1788586897.749837:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453696 00000100:00100000:2.0:1788586897.749850:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454208 00000100:00100000:2.0:1788586897.749853:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454208 00000100:00100000:2.0:1788586897.749868:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586897.749876:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127453824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.749927:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127453824:12345-0@lo:400:kworker.0 Request processed in 53us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.750037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452800 00000100:00100000:3.0:1788586897.750042:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452800 00000100:00100000:3.0:1788586897.750070:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788586897.750077:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127452800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.750124:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127452800:12345-0@lo:400:kworker.0 Request processed in 48us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.750131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788586897.751440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127452928 00000100:00100000:3.0:1788586897.751450:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127452928 00000100:00100000:3.0:1788586897.751486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453440 00000100:00100000:3.0:1788586897.751490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453440 00000100:00100000:3.0:1788586897.751504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453952 00000100:00100000:3.0:1788586897.751507:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453952 00000100:00100000:3.0:1788586897.751519:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453568 00000100:00100000:3.0:1788586897.751521:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453568 00000100:00100000:3.0:1788586897.751532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454080 00000100:00100000:3.0:1788586897.751535:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454080 00000100:00100000:3.0:1788586897.751545:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453184 00000100:00100000:3.0:1788586897.751548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453184 00000100:00100000:3.0:1788586897.751562:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788586897.751569:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127452928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.751645:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127452928:12345-0@lo:400:kworker.0 Request processed in 75us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.751652:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788586897.751667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788586897.751673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127453440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.751701:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127453440:12345-0@lo:400:kworker.0 Request processed in 28us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.751707:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788586897.751717:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586897.751722:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127453952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.751750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127453952:12345-0@lo:400:kworker.0 Request processed in 28us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.751755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586897.751765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788586897.751771:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127453568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.751806:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127453568:12345-0@lo:400:kworker.0 Request processed in 36us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.751812:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788586897.751823:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788586897.751828:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127454080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.751853:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127454080:12345-0@lo:400:kworker.0 Request processed in 24us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.751858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788586897.751868:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788586897.751873:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127453184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.751907:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127453184:12345-0@lo:400:kworker.0 Request processed in 34us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.751913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788586897.752031:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586897.752039:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.752072:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127454336:12345-0@lo:400:kworker.0 Request processed in 34us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.752077:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788586897.752093:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586897.752099:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127453696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.752137:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127453696:12345-0@lo:400:kworker.0 Request processed in 38us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.752142:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788586897.752153:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586897.752159:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586897.752186:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127454208:12345-0@lo:400:kworker.0 Request processed in 27us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586897.752191:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788586897.752292:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788586897.752306:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127454592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586897.752342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586897.752386:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453312 00000100:00100000:1.0:1788586897.752390:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453312 00000100:00100000:1.0:1788586897.752434:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127453056 00000100:00100000:1.0:1788586897.752438:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127453056 00000100:00100000:1.0:1788586897.752452:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788586897.752457:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127453312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586897.752491:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127453312:12345-0@lo:400:kworker.0 Request processed in 33us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586897.752497:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788586897.752510:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788586897.752515:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127453056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586897.752540:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127453056:12345-0@lo:400:kworker.0 Request processed in 25us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586897.752545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788586897.752564:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454464 00000100:00100000:1.0:1788586897.752568:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454464 00000100:00100000:1.0:1788586897.752583:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454592 00000100:00100000:1.0:1788586897.752586:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454592 00000100:00100000:1.0:1788586897.752596:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788586897.752601:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127454464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788586897.752623:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586897.752654:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127454464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586897.752668:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788586897.752681:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788586897.752686:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127454592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586897.752695:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586897.752724:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127454592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586897.752729:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788586897.752773:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372b480 x1875469127454592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586897.752791:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127454592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586897.752874:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788586897.752897:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586897.752901:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586897.752904:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586897.752905:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788586897.753005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127453184:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753022:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccf800 x1875469127453696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127453696:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753043:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccd880 x1875469127454208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753052:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127454208:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.753063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127453056:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753074:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccd180 x1875469127453568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753082:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127453568:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753091:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccc700 x1875469127454080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753118:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.753158:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127452928:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.753169:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127453440:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.753178:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127453952:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753187:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccc000 x1875469127454464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753199:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127454464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586897.753209:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127452800:0@lo:400:kworker.0 00000100:00100000:2.0:1788586897.753219:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127453312:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccce00 x1875469127453824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753235:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127453824:0@lo:400:kworker.0 00010000:00080000:2.0:1788586897.753242:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ccdc00 x1875469127454336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586897.753248:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127454336:0@lo:400:kworker.0 00010000:00010000:2.0:1788586897.878899:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586898.772700:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586898.772722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127454720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586898.772787:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586898.772915:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454720 00000100:00100000:1.0:1788586898.772923:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454720 00000100:00100000:1.0:1788586898.772969:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788586898.772980:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127454720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788586898.773009:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586898.773057:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127454720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.773069:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788586898.773089:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586898.773107:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127454848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586898.773132:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586898.773156:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454848 00000100:00100000:1.0:1788586898.773159:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454848 00000100:00100000:1.0:1788586898.773177:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788586898.773182:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127454848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788586898.773209:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586898.773249:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127454848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.773256:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788586898.773298:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372b480 x1875469127454848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586898.773322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127454848:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788586898.773359:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb01c00 x1875469127454720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586898.773378:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127454720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586898.779638:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127454976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586898.779712:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.780032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127454976 00000100:00100000:3.0:1788586898.780041:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127454976 00000100:00100000:3.0:1788586898.780091:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788586898.780112:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127454976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788586898.780156:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586898.780205:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127454976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586898.780213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788586898.780779:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127454976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788586898.900727:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586899.596307:0:10939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing yml_node 00010000:00010000:1.0:1788586899.925705:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586900.308630:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788586900.308654:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127455104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586900.308722:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586900.308784:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455104 00000100:00100000:2.0:1788586900.308798:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455104 00000100:00100000:2.0:1788586900.308846:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788586900.308856:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127455104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586900.308890:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586900.308936:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127455104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586900.308943:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788586900.308991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127455104:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788586900.949281:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586901.621103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586901.621163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586901.621194:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586901.621229:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586901.621263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586901.621344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110615936 00000100:00100000:2.0:1788586901.621354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110615936 00000100:00100000:2.0:1788586901.621410:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 276 00000100:00100000:2.0:1788586901.621449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110615936:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586901.621517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110615936:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 73us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586901.621537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 276 00000100:00100000:1.0:1788586901.621932:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616448 00000100:00100000:1.0:1788586901.621937:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616448 00000100:00100000:1.0:1788586901.621989:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616320 00000100:00100000:1.0:1788586901.621992:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616320 00000100:00100000:1.0:1788586901.622010:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:1.0:1788586901.622017:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110616448:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586901.622051:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110616448:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 34us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586901.622057:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:1.0:1788586901.622091:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:1.0:1788586901.622098:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110616320:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586901.622123:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110616320:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586901.622129:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:3.0:1788586901.624167:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616192 00000100:00100000:3.0:1788586901.624180:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616192 00000100:00100000:3.0:1788586901.624246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616064 00000100:00100000:3.0:1788586901.624250:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616064 00000100:00100000:3.0:1788586901.624282:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:3.0:1788586901.624291:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110616192:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586901.624356:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110616192:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 66us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586901.624363:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:3.0:1788586901.624380:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00100000:3.0:1788586901.624386:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110616064:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586901.624411:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110616064:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586901.624452:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00080000:2.0:1788586901.624536:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586901.624540:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586901.624542:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788586901.624545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788586901.972638:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586902.868935:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127455232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586902.868999:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586902.869745:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586902.869761:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586902.869957:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455232 00000100:00100000:2.0:1788586902.869965:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455232 00000100:00100000:2.0:1788586902.870015:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788586902.870024:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127455232:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586902.870131:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.871016:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127455616:0@lo:400:kworker.0 00002000:00000024:2.0:1788586902.871221:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586902.871279:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127455232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1255us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586902.871287:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788586902.871307:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455360 00000100:00100000:2.0:1788586902.871311:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455360 00000100:00100000:2.0:1788586902.871334:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788586902.871341:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127455360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586902.871349:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586902.871372:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127455360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586902.871377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788586902.871395:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127455872:0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871440:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586902.871460:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127456384:0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871481:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586902.871498:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788586902.871503:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127455488:0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586902.871546:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127456000:0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871575:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586902.871590:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127456512:0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871612:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788586902.871633:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586902.871646:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455872 00000100:00100000:2.0:1788586902.871649:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455872 00000100:00100000:2.0:1788586902.871672:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788586902.871678:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127455872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871712:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127455872:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586902.871717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788586902.871732:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456384 00000100:00100000:2.0:1788586902.871735:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456384 00000100:00100000:2.0:1788586902.871757:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456512 00000100:00100000:2.0:1788586902.871760:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456512 00000100:00100000:2.0:1788586902.871776:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788586902.871781:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127456384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871807:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127456384:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586902.871813:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788586902.871822:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788586902.871827:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5baf362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127456512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.871848:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5baf362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127456512:12345-0@lo:400:kworker.0 Request processed in 22us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586902.871853:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788586902.871980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455488 00000100:00100000:2.0:1788586902.871984:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455488 00000100:00100000:2.0:1788586902.872004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788586902.872010:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127455488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.874729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.874773:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127456128:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.874796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.874817:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127456640:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.874852:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.874882:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788586902.874888:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127455744:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.874911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.874930:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127456256:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.874948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.874960:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127456768:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.874978:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586902.875282:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456000 00000100:00100000:3.0:1788586902.875291:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456000 00000100:00100000:3.0:1788586902.875334:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455744 00000100:00100000:3.0:1788586902.875337:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455744 00000100:00100000:3.0:1788586902.875352:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788586902.875360:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127456000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.875413:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127456000:12345-0@lo:400:kworker.0 Request processed in 53us (3836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586902.875444:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788586902.875462:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586902.875468:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127455744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.875501:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127455744:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586902.875507:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586902.875543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127455744:0@lo:400:kworker.0 00010000:00080000:3.0:1788586902.875580:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83728e00 x1875469127455360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586902.875599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586902.876042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127455616 00000100:00100000:1.0:1788586902.876048:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127455616 00000100:00100000:1.0:1788586902.876082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456128 00000100:00100000:1.0:1788586902.876085:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456128 00000100:00100000:1.0:1788586902.876102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456640 00000100:00100000:1.0:1788586902.876105:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456640 00000100:00100000:1.0:1788586902.876118:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456256 00000100:00100000:1.0:1788586902.876121:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456256 00000100:00100000:1.0:1788586902.876132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456768 00000100:00100000:1.0:1788586902.876134:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456768 00000100:00100000:1.0:1788586902.876148:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788586902.876154:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127455616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586902.876207:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127455616:12345-0@lo:400:kworker.0 Request processed in 53us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586902.876214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788586902.876228:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788586902.876233:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127456128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586902.876259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127456128:12345-0@lo:400:kworker.0 Request processed in 26us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586902.876264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788586902.876284:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788586902.876290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127456640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586902.876317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127456640:12345-0@lo:400:kworker.0 Request processed in 28us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586902.876322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788586902.876333:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788586902.876338:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127456256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586902.876363:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127456256:12345-0@lo:400:kworker.0 Request processed in 25us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586902.876369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788586902.876380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788586902.876385:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127456768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586902.876409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127456768:12345-0@lo:400:kworker.0 Request processed in 24us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586902.876436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788586902.876982:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127456000:0@lo:400:kworker.0 00010000:00080000:2.0:1788586902.877000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb01c00 x1875469127456512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586902.877010:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127456512:0@lo:400:kworker.0 00000100:00100000:2.0:1788586902.877035:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127455872:0@lo:400:kworker.0 00010000:00080000:2.0:1788586902.877047:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb03100 x1875469127456384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586902.877055:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127456384:0@lo:400:kworker.0 00000100:00080000:2.0:1788586902.877099:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586902.877103:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586902.877106:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586902.877139:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a835d8000 x1875469127455232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586902.877154:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127455232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586902.877210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127455488:12345-0@lo:400:kworker.0 Request processed in 5199us (5680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586902.877217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:3.0:1788586902.877312:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb02d80 x1875469127456256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586902.877322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127456256:0@lo:400:kworker.0 00010000:00080000:3.0:1788586902.877332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a3b80 x1875469127456768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586902.877340:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127456768:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.877350:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127455616:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.877359:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127456128:0@lo:400:kworker.0 00000100:00100000:3.0:1788586902.877369:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127456640:0@lo:400:kworker.0 00000100:00100000:1.0:1788586902.878128:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127455488:0@lo:400:kworker.0 00010000:00010000:1.0:1788586902.997557:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788586903.172966:0:11122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788586903.892593:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788586903.892616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127456896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788586903.892682:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586903.892742:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586903.892774:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586903.892797:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127457152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586903.892882:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586903.892918:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457152 00000100:00100000:2.0:1788586903.892925:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457152 00000100:00100000:3.0:1788586903.892940:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127456896 00000100:00100000:3.0:1788586903.892946:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127456896 00000100:00100000:3.0:1788586903.892973:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457024 00000100:00100000:3.0:1788586903.892976:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457024 00000100:00100000:2.0:1788586903.892980:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788586903.892992:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127457152:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586903.892994:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586903.893005:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127456896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788586903.893031:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1788586903.893033:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586903.893298:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127456896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 294us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586903.893306:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586903.893323:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586903.893330:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127457024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586903.893341:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586903.893367:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127457024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586903.893379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788586903.893908:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83728000 x1875469127456896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586903.893926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127456896:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788586903.893937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a835d8000 x1875469127457024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586903.893947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586903.895644:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127457152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2649us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586903.895658:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788586903.895728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127457152:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788586904.020543:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586905.047904:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586905.428702:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127457280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586905.428777:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586905.428859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457280 00000100:00100000:2.0:1788586905.428868:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457280 00000100:00100000:2.0:1788586905.428934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788586905.428944:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127457280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586905.428991:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586905.429060:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127457280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586905.429068:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788586905.429192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127457280:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788586905.461731:0:11219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:2.0:1788586906.068498:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586906.736977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586906.737021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586906.737067:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586906.737092:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616576 00000100:00100000:0.0:1788586906.737097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586906.737102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616576 00000100:00100000:0.0:1788586906.737119:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586906.737147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 278 00000100:00100000:3.0:1788586906.737157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110616576:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586906.737197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616832 00000100:00100000:1.0:1788586906.737201:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616832 00000100:00100000:3.0:1788586906.737226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+10:2408:x1875469110616576:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586906.737234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 278 00000100:00100000:1.0:1788586906.737242:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616704 00000100:00100000:1.0:1788586906.737244:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616704 00000100:00100000:1.0:1788586906.737265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:1.0:1788586906.737272:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110616832:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586906.737283:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:3.0:1788586906.737289:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110616704:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586906.737310:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110616704:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586906.737316:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00080000:0.0:1788586906.737333:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586906.737337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788586906.737457:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110616960 00000100:00100000:2.0:1788586906.737462:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110616960 00000100:00100000:2.0:1788586906.737498:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617088 00000100:00100000:2.0:1788586906.737501:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617088 00000100:00100000:2.0:1788586906.737522:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:2.0:1788586906.737529:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2405:x1875469110616960:12345-192.168.203.1@tcp:9:kworker.0 00000020:00000080:2.0:1788586906.737553:0:10047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd985c 00000100:00080000:3.0:1788586906.737563:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586906.737563:0:10047:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb22800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788586906.737566:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788586906.737602:0:10047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788586906.737648:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:0.0:1788586906.737657:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2405:x1875469110617088:12345-192.168.203.1@tcp:9:kworker.0 00000020:00000080:0.0:1788586906.737674:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9863 00000100:00080000:0.0:1788586906.737680:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa0e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788586906.737710:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788586906.738143:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110616832:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 869us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586906.738152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 77 00010000:00010000:1.0:1788586906.738183:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586906.739706:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+2:2405:x1875469110617088:12345-192.168.203.1@tcp:9:kworker.0 Request processed in 2039us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586906.739718:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:2.0:1788586906.740590:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+2:2405:x1875469110616960:12345-192.168.203.1@tcp:9:kworker.0 Request processed in 3056us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586906.740601:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00010000:00010000:2.0:1788586906.740670:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586907.092841:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788586907.891750:0:11317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:0.0:1788586907.989739:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788586907.989769:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127457408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586907.989841:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586907.989934:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457408 00000100:00100000:2.0:1788586907.989941:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457408 00000100:00100000:2.0:1788586907.989998:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788586907.990009:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127457408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788586907.990045:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586907.990094:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127457408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586907.990104:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788586907.990146:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a835daa00 x1875469127457408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586907.990164:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127457408:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788586907.990455:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586907.990645:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586907.990654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127457536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586907.990686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586907.990720:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457536 00000100:00100000:2.0:1788586907.990724:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457536 00000100:00100000:2.0:1788586907.990758:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788586907.990766:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127457536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586907.990781:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586907.990814:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127457536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586907.990821:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788586907.990851:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a835daa00 x1875469127457536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586907.990866:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127457536:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788586907.990926:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586907.991066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127457920:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586907.991129:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127458432:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991174:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127458048:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991176:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586907.991209:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127458944:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991217:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586907.991245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586907.991247:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127458560:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991275:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788586907.991284:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127457792:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991293:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586907.991328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788586907.991333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586907.991338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127457664:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127458304:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991372:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586907.991396:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586907.991401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127458176:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991445:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127458816:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991593:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586907.991618:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127458688:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991643:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586907.991664:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586907.991678:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458432 00000100:00100000:0.0:1788586907.991685:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458432 00000100:00100000:3.0:1788586907.991697:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457920 00000100:00100000:3.0:1788586907.991703:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457920 00000100:00100000:0.0:1788586907.991725:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458048 00000100:00100000:0.0:1788586907.991729:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458048 00000100:00100000:3.0:1788586907.991739:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458176 00000100:00100000:3.0:1788586907.991745:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458176 00000100:00100000:0.0:1788586907.991749:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458944 00000100:00100000:0.0:1788586907.991754:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458944 00000100:00100000:3.0:1788586907.991774:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788586907.991776:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457792 00000100:00100000:0.0:1788586907.991779:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457792 00000100:00100000:3.0:1788586907.991785:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127457920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458304 00000100:00100000:0.0:1788586907.991803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458304 00000100:00100000:0.0:1788586907.991826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458816 00000100:00100000:0.0:1788586907.991828:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458816 00000100:00100000:3.0:1788586907.991835:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127457920:12345-0@lo:400:kworker.0 Request processed in 53us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586907.991842:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788586907.991848:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788586907.991857:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127458432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991863:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788586907.991872:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127458176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991900:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127458432:12345-0@lo:400:kworker.0 Request processed in 45us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.991909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788586907.991917:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127458176:12345-0@lo:400:kworker.0 Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.991924:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788586907.991926:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788586907.991936:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127458048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.991956:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788586907.991968:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127458944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.991975:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127458048:12345-0@lo:400:kworker.0 Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.991984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788586907.992007:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788586907.992013:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127458944:12345-0@lo:400:kworker.0 Request processed in 47us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.992018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127457792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.992025:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788586907.992059:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788586907.992067:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127457792:12345-0@lo:400:kworker.0 Request processed in 52us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586907.992069:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127458304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.992078:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788586907.992097:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788586907.992105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127458816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.992120:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127458304:12345-0@lo:400:kworker.0 Request processed in 53us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586907.992128:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788586907.992144:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127458816:12345-0@lo:400:kworker.0 Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.992151:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788586907.992177:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458560 00000100:00100000:0.0:1788586907.992181:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458560 00000100:00100000:0.0:1788586907.992209:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127458688 00000100:00100000:0.0:1788586907.992212:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127458688 00000100:00100000:0.0:1788586907.992248:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586907.992257:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.992299:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127458560:12345-0@lo:400:kworker.0 Request processed in 44us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.992306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586907.992321:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788586907.992328:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127458688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.992358:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127458688:12345-0@lo:400:kworker.0 Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586907.992364:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788586907.992396:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586907.992401:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586907.992404:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586907.992489:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127457792:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.992500:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127458304:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.992507:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127458816:0@lo:400:kworker.0 00000100:00100000:3.0:1788586907.992515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127457920:0@lo:400:kworker.0 00010000:00080000:3.0:1788586907.992526:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a1500 x1875469127458432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586907.992536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127458432:0@lo:400:kworker.0 00010000:00080000:3.0:1788586907.992544:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a3800 x1875469127458944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586907.992551:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127458944:0@lo:400:kworker.0 00000100:00100000:2.0:1788586907.993029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127457664 00000100:00100000:2.0:1788586907.993046:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127457664 00000100:00100000:2.0:1788586907.993083:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788586907.993091:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127457664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586907.993645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127457664:12345-0@lo:400:kworker.0 Request processed in 554us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586907.993655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788586907.993722:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127458176:0@lo:400:kworker.0 00010000:00080000:0.0:1788586907.993748:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a2300 x1875469127458688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586907.993760:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127458688:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.993772:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127458048:0@lo:400:kworker.0 00010000:00080000:0.0:1788586907.993784:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a1f80 x1875469127458560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586907.993793:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127458560:0@lo:400:kworker.0 00000100:00100000:0.0:1788586907.993818:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127457664:0@lo:400:kworker.0 00010000:00010000:1.0:1788586908.117023:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586909.013543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586909.013566:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127459072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586909.013644:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586909.013707:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459072 00000100:00100000:3.0:1788586909.013714:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459072 00000100:00100000:3.0:1788586909.013835:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586909.013844:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127459072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788586909.013872:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586909.013911:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127459072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586909.013930:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788586909.013987:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83756300 x1875469127459072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586909.014003:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127459072:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788586909.014265:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586909.014505:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127459200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586909.014534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586909.014600:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459200 00000100:00100000:2.0:1788586909.014606:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459200 00000100:00100000:2.0:1788586909.014713:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788586909.014720:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127459200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788586909.014732:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586909.014762:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127459200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586909.014768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788586909.019457:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127459328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586909.019520:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586909.019580:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459328 00000100:00100000:2.0:1788586909.019587:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459328 00000100:00100000:2.0:1788586909.019630:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788586909.019638:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127459328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586909.019668:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586909.019707:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127459328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586909.019714:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788586909.019754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127459328:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788586909.019832:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788586909.019871:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a835daa00 x1875469127459200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586909.019884:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127459200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788586909.141554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586909.251955:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 01:41:47 EDT 2026 00010000:00010000:2.0:1788586910.164676:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586910.550101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586910.550123:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127459456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586910.550187:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586910.550311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459456 00000100:00100000:2.0:1788586910.550319:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459456 00000100:00100000:2.0:1788586910.550362:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788586910.550371:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127459456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586910.550403:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586910.550575:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127459456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 204us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586910.550582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788586910.550627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127459456:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788586911.189143:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586911.850865:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586911.850914:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586911.850980:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586911.851061:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617344 00000100:00100000:0.0:1788586911.851071:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617344 00000100:00100000:0.0:1788586911.851134:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617472 00000100:00100000:0.0:1788586911.851137:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617472 00000100:00100000:0.0:1788586911.851160:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 85 00000100:00100000:0.0:1788586911.851169:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2407:x1875469110617344:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586911.851241:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2407:x1875469110617344:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 72us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586911.851248:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 85 00000100:00100000:0.0:1788586911.851269:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 86 00000100:00100000:0.0:1788586911.851277:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110617472:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586911.851306:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110617472:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586911.851313:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 86 00000100:00080000:2.0:1788586911.851442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586911.851446:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586911.851540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617216 00000100:00100000:1.0:1788586911.851545:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617216 00000100:00100000:1.0:1788586911.851608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 280 00000100:00100000:1.0:1788586911.851616:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2407:x1875469110617216:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586911.851657:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2407:x1875469110617216:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 42us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586911.851663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 280 00000001:00100000:0.0:1788586912.086579:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:0.0:1788586912.086589:0:9513:0:(genops.c:885:class_export_put()) final put ffff8f5bbfa0c800/207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:2.0:1788586912.087615:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfa0c800/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-OST0001 00000020:00000080:2.0:1788586912.087678:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfa0e800 for lustre-OST0001 00000001:00100000:0.0:1788586912.087790:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:0.0:1788586912.087796:0:8429:0:(genops.c:885:class_export_put()) final put ffff8f5bbfb21800/207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:2.0:1788586912.094024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfb21800/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-OST0000 00000020:00000080:2.0:1788586912.094091:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfb22800 for lustre-OST0000 00010000:00010000:2.0:1788586912.213715:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586913.108636:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127459584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586913.108717:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586913.108834:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459584 00000100:00100000:1.0:1788586913.108842:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459584 00000100:00100000:1.0:1788586913.108908:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788586913.108920:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127459584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586913.108952:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586913.109010:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127459584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586913.109017:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788586913.109113:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586913.109296:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127459712:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109342:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109359:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127459840:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109375:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127460096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586913.109409:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586913.109410:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586913.109456:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127460736:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.109462:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127460352:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586913.109522:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127461248:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.109536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127460864:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109547:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586913.109573:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788586913.109579:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127460224:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.109585:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586913.109610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109616:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788586913.109625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127459968:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109635:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127460608:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.109655:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586913.109666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109677:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127460480:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127461120:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.109708:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109731:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127460992:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109738:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109762:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586913.109797:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459840 00000100:00100000:0.0:1788586913.109801:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459840 00000100:00100000:0.0:1788586913.109831:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460224 00000100:00100000:0.0:1788586913.109835:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460224 00000100:00100000:3.0:1788586913.109839:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459712 00000100:00100000:3.0:1788586913.109844:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459712 00000100:00100000:0.0:1788586913.109852:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460608 00000100:00100000:0.0:1788586913.109857:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460608 00000100:00100000:0.0:1788586913.109884:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460480 00000100:00100000:0.0:1788586913.109887:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460480 00000100:00100000:0.0:1788586913.109905:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461120 00000100:00100000:0.0:1788586913.109908:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461120 00000100:00100000:0.0:1788586913.109920:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460992 00000100:00100000:0.0:1788586913.109923:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460992 00000100:00100000:0.0:1788586913.109940:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788586913.109948:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127459840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.109996:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788586913.109998:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127459840:12345-0@lo:400:kworker.0 Request processed in 46us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586913.110017:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788586913.110034:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788586913.110042:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127460224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110051:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127459712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110089:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127459712:12345-0@lo:400:kworker.0 Request processed in 51us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788586913.110124:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460736 00000100:00100000:3.0:1788586913.110127:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460736 00000100:00100000:3.0:1788586913.110151:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461248 00000100:00100000:3.0:1788586913.110154:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461248 00000100:00100000:3.0:1788586913.110167:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460864 00000100:00100000:3.0:1788586913.110169:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460864 00000100:00100000:3.0:1788586913.110181:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788586913.110187:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127460736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110220:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127460736:12345-0@lo:400:kworker.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110226:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788586913.110237:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586913.110242:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127461248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110268:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127461248:12345-0@lo:400:kworker.0 Request processed in 26us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110273:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586913.110282:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788586913.110288:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127460864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110322:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127460864:12345-0@lo:400:kworker.0 Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788586913.110349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788586913.110356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127460608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110382:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127460608:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110387:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788586913.110398:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788586913.110403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127460480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110452:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127460480:12345-0@lo:400:kworker.0 Request processed in 48us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788586913.110475:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788586913.110482:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127461120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.110502:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127460224:12345-0@lo:400:kworker.0 Request processed in 460us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586913.110509:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788586913.110524:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127461120:12345-0@lo:400:kworker.0 Request processed in 42us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586913.110529:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788586913.110537:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788586913.110541:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127460992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110575:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460096 00000100:00100000:0.0:1788586913.110576:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127460992:12345-0@lo:400:kworker.0 Request processed in 39us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110580:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460096 00000100:00100000:0.0:1788586913.110586:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788586913.110610:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127460352 00000100:00100000:0.0:1788586913.110614:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127460352 00000100:00100000:3.0:1788586913.110615:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586913.110625:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127460096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788586913.110638:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586913.110642:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127459968 00000100:00100000:0.0:1788586913.110646:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127459968 00000100:00100000:0.0:1788586913.110664:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788586913.110673:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127460352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110678:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127460096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110694:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586913.110715:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127460352:12345-0@lo:400:kworker.0 Request processed in 42us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586913.110722:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788586913.110736:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127460224:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.110739:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788586913.110751:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127459968:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788586913.110759:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83771880 x1875469127460608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586913.110769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127460608:0@lo:400:kworker.0 00010000:00080000:3.0:1788586913.110783:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83773100 x1875469127461120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586913.110788:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127459968:12345-0@lo:400:kworker.0 Request processed in 37us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586913.110800:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127461120:0@lo:400:kworker.0 00000100:00100000:0.0:1788586913.110802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788586913.110819:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83771c00 x1875469127460736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586913.110828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127460736:0@lo:400:kworker.0 00000100:00080000:0.0:1788586913.110835:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586913.110840:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788586913.110841:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83770a80 x1875469127461248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788586913.110845:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586913.110849:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586913.110856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127461248:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.110865:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127459712:0@lo:400:kworker.0 00010000:00080000:1.0:1788586913.111033:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372ad80 x1875469127459584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586913.111049:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127459584:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788586913.111672:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83757800 x1875469127460096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586913.111687:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127460096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586913.111750:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127459968:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.111761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127460480:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.111787:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127460992:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.111796:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127459840:0@lo:400:kworker.0 00000100:00100000:3.0:1788586913.111806:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127460352:0@lo:400:kworker.0 00010000:00080000:3.0:1788586913.111817:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83770000 x1875469127460864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586913.111825:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127460864:0@lo:400:kworker.0 00010000:00010000:2.0:1788586913.236601:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586914.132593:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586914.132618:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127461376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586914.132690:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586914.132757:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461376 00000100:00100000:3.0:1788586914.132765:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461376 00000100:00100000:3.0:1788586914.132815:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788586914.132826:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127461376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586914.132853:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586914.132922:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127461376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586914.132929:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788586914.132974:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83757800 x1875469127461376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586914.133003:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127461376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586914.133519:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127461504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586914.133551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586914.136929:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586914.136962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127461632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586914.137046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586914.137703:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461632 00000100:00100000:3.0:1788586914.137721:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461632 00000100:00100000:3.0:1788586914.137799:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586914.137808:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127461632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788586914.137830:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586914.138214:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127461632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 406us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586914.138221:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788586914.138293:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372ad80 x1875469127461632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586914.138313:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127461632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788586914.138817:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461504 00000100:00100000:2.0:1788586914.138826:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461504 00000100:00100000:2.0:1788586914.138886:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788586914.138894:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127461504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586914.138921:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586914.138975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127461504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (5423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586914.138982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788586914.139177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127461504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788586914.260604:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586915.284589:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586915.668634:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586915.668659:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127461760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586915.668727:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586915.668786:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461760 00000100:00100000:2.0:1788586915.668793:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461760 00000100:00100000:2.0:1788586915.668836:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788586915.668845:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127461760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586915.668877:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586915.670357:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127461760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1506us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586915.670369:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788586915.674258:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127461760:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788586916.309225:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586916.976914:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586916.976968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586916.977026:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586916.977064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617856 00000100:00100000:3.0:1788586916.977073:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617856 00000100:00100000:3.0:1788586916.977171:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617728 00000100:00100000:3.0:1788586916.977175:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617728 00000100:00100000:3.0:1788586916.977211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 93 00000100:00100000:3.0:1788586916.977222:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110617856:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586916.977293:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110617856:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586916.977303:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 93 00000100:00100000:3.0:1788586916.977328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 94 00000100:00100000:3.0:1788586916.977337:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110617728:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586916.977368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110617728:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586916.977376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 94 00000100:00080000:3.0:1788586916.977464:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586916.977470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586916.977645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617600 00000100:00100000:1.0:1788586916.977651:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617600 00000100:00100000:1.0:1788586916.977700:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 282 00000100:00100000:1.0:1788586916.977713:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110617600:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586916.977747:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110617600:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 37us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586916.977757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 282 00010000:00010000:0.0:1788586917.336053:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586918.234503:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127461888:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234580:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234626:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127462400:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234654:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234673:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127462912:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234695:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127463424:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234774:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788586918.234780:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127462016:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234804:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234821:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127462528:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234840:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234856:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127463040:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234874:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234902:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127462144:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234924:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234941:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127462656:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.234962:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.234999:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127463168:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235019:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.235032:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788586918.235046:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127462272:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235070:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.235081:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127462784:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235100:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.235117:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127463296:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586918.235166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127461888 00000100:00100000:0.0:1788586918.235173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127461888 00000100:00100000:0.0:1788586918.235220:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788586918.235230:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127461888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127461888:12345-0@lo:400:kworker.0 Request processed in 47us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788586918.235313:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462400 00000100:00100000:0.0:1788586918.235317:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462400 00000100:00100000:0.0:1788586918.235342:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462144 00000100:00100000:0.0:1788586918.235345:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462144 00000100:00100000:0.0:1788586918.235360:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788586918.235366:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127462400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235399:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127462400:12345-0@lo:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235406:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788586918.235439:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788586918.235445:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127462144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235478:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127462144:12345-0@lo:400:kworker.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788586918.235512:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462912 00000100:00100000:0.0:1788586918.235516:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462912 00000100:00100000:0.0:1788586918.235544:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463424 00000100:00100000:0.0:1788586918.235547:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463424 00000100:00100000:0.0:1788586918.235558:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462784 00000100:00100000:0.0:1788586918.235560:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462784 00000100:00100000:0.0:1788586918.235571:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463296 00000100:00100000:0.0:1788586918.235573:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463296 00000100:00100000:0.0:1788586918.235586:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586918.235592:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127462912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235625:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127462912:12345-0@lo:400:kworker.0 Request processed in 33us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235631:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586918.235642:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586918.235648:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127463424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235675:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127463424:12345-0@lo:400:kworker.0 Request processed in 27us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235680:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586918.235692:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586918.235698:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127462784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235724:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127462784:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235729:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586918.235739:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788586918.235745:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127463296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235781:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127463296:12345-0@lo:400:kworker.0 Request processed in 37us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235787:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788586918.235809:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462016 00000100:00100000:0.0:1788586918.235813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462016 00000100:00100000:0.0:1788586918.235830:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462528 00000100:00100000:0.0:1788586918.235832:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462528 00000100:00100000:0.0:1788586918.235843:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463040 00000100:00100000:0.0:1788586918.235845:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463040 00000100:00100000:0.0:1788586918.235853:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462656 00000100:00100000:0.0:1788586918.235855:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462656 00000100:00100000:0.0:1788586918.235864:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463168 00000100:00100000:0.0:1788586918.235866:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463168 00000100:00100000:0.0:1788586918.235876:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127462272 00000100:00100000:0.0:1788586918.235878:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127462272 00000100:00100000:0.0:1788586918.235888:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788586918.235893:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127462016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235923:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127462016:12345-0@lo:400:kworker.0 Request processed in 29us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235929:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788586918.235940:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788586918.235946:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127462528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.235983:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127462528:12345-0@lo:400:kworker.0 Request processed in 38us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.235989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788586918.236001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586918.236007:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127463040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236034:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127463040:12345-0@lo:400:kworker.0 Request processed in 27us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.236046:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586918.236059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788586918.236064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127462656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236092:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127462656:12345-0@lo:400:kworker.0 Request processed in 28us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.236098:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788586918.236109:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788586918.236114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127463168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236141:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127463168:12345-0@lo:400:kworker.0 Request processed in 27us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.236146:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788586918.236157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788586918.236162:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127462272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236186:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127462272:12345-0@lo:400:kworker.0 Request processed in 24us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586918.236191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788586918.236236:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788586918.236240:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586918.236242:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586918.236244:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586918.236270:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127462272:0@lo:400:kworker.0 00010000:00080000:0.0:1788586918.236285:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83595180 x1875469127462784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586918.236296:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127462784:0@lo:400:kworker.0 00010000:00080000:0.0:1788586918.236319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83594700 x1875469127463296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586918.236327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127463296:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236337:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127462144:0@lo:400:kworker.0 00010000:00080000:0.0:1788586918.236346:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83596300 x1875469127462656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586918.236354:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127462656:0@lo:400:kworker.0 00010000:00080000:0.0:1788586918.236364:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83597b80 x1875469127463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586918.236372:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127463168:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236445:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127462016:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127462528:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127463040:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127461888:0@lo:400:kworker.0 00000100:00100000:0.0:1788586918.236488:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127462400:0@lo:400:kworker.0 00010000:00080000:0.0:1788586918.236498:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83597800 x1875469127462912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586918.236506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127462912:0@lo:400:kworker.0 00010000:00080000:0.0:1788586918.236517:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83595880 x1875469127463424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586918.236537:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127463424:0@lo:400:kworker.0 00000100:00100000:2.0:1788586918.240365:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586918.240461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586918.240520:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463552 00000100:00100000:2.0:1788586918.240529:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463552 00000100:00100000:2.0:1788586918.240579:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788586918.240588:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127463552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586918.240627:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586918.240674:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127463552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586918.240681:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788586918.240721:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcaf5c00 x1875469127463552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586918.240740:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586918.241352:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586918.241363:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127463680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586918.241394:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586918.241444:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463680 00000100:00100000:2.0:1788586918.241448:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463680 00000100:00100000:2.0:1788586918.241473:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788586918.241479:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127463680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788586918.241491:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586918.241522:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127463680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586918.241528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788586918.241554:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb4e35f80 x1875469127463680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586918.241568:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127463680:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788586918.356619:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586919.256358:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586919.256381:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127463808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788586919.256934:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127463936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586919.256996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586919.257256:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.257348:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463808 00000100:00100000:0.0:1788586919.257356:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463808 00000100:00100000:0.0:1788586919.257455:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788586919.257466:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127463808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788586919.257501:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586919.257815:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127463808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 351us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586919.257824:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788586919.257881:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372ad80 x1875469127463808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586919.257900:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127463808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586919.257933:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586919.257941:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127464064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586919.257968:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127463936 00000100:00100000:2.0:1788586919.257983:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127463936 00000100:00100000:1.0:1788586919.258018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.258024:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788586919.258033:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127463936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586919.258056:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586919.258763:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127463936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 728us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.258772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788586919.258833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127463936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586919.259190:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464064 00000100:00100000:3.0:1788586919.259202:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464064 00000100:00100000:3.0:1788586919.259237:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788586919.259244:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127464064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586919.259260:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586919.259307:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127464064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.259314:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788586919.259677:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83757800 x1875469127464064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586919.259708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127464064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788586919.380780:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586920.404637:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586920.794827:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127464192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586920.794909:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586920.795122:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464192 00000100:00100000:2.0:1788586920.795131:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464192 00000100:00100000:2.0:1788586920.795182:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788586920.795193:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127464192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586920.795226:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586920.795285:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127464192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586920.795292:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788586920.795382:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127464192:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788586921.428716:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586922.093460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586922.093500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586922.093553:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586922.093578:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618112 00000100:00100000:3.0:1788586922.093586:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618112 00000100:00100000:3.0:1788586922.093639:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618240 00000100:00100000:3.0:1788586922.093643:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618240 00000100:00100000:3.0:1788586922.093668:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 101 00000100:00100000:3.0:1788586922.093677:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110618112:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586922.093771:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110618112:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 95us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586922.093779:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 101 00000100:00100000:3.0:1788586922.093793:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:3.0:1788586922.093798:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110618240:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586922.093821:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110618240:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586922.093824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:3.0:1788586922.093849:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110617984 00000100:00100000:3.0:1788586922.093860:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110617984 00000100:00100000:3.0:1788586922.094060:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 284 00000100:00100000:3.0:1788586922.094068:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110617984:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586922.094103:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+10:2409:x1875469110617984:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586922.094109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 284 00000100:00080000:3.0:1788586922.094136:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788586922.094140:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788586922.458601:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586922.665806:0:11994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:42:01 (1788586921) === 00000100:00100000:2.0:1788586923.097372:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.097457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618368 00000100:00100000:0.0:1788586923.097467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618368 00000100:00100000:0.0:1788586923.097524:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 285 00000100:00100000:0.0:1788586923.097535:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+10:8717:x1875469110618368:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788586923.097549:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586923.097567:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8106ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586923.097595:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106ed expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586923.097606:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106ed expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586923.097646:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5000, rc 0) 00000100:00100000:0.0:1788586923.097705:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+11:8717:x1875469110618368:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 172us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.097712:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 285 00000100:00100000:3.0:1788586923.100468:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.100570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618496 00000100:00100000:0.0:1788586923.100580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618496 00000100:00100000:0.0:1788586923.100643:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 286 00000100:00100000:0.0:1788586923.100654:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+11:8717:x1875469110618496:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788586923.100813:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+11:8717:x1875469110618496:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.100821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 286 00000100:00100000:1.0:1788586923.112373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.112712:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618624 00000100:00100000:3.0:1788586923.112721:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618624 00000100:00100000:3.0:1788586923.112772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 287 00000100:00100000:3.0:1788586923.112781:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+11:8717:x1875469110618624:12345-192.168.203.1@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788586923.112924:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+11:8717:x1875469110618624:12345-192.168.203.1@tcp:503:mount.lustre.0 Request processed in 143us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.112940:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 287 00000100:00100000:2.0:1788586923.121530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586923.121758:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618752 00000100:00100000:1.0:1788586923.121768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618752 00000100:00100000:1.0:1788586923.121825:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 288 00000100:00100000:1.0:1788586923.121834:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+11:8721:x1875469110618752:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788586923.122009:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+11:8721:x1875469110618752:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 175us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.122017:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 288 00000100:00100000:1.0:1788586923.150801:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.150904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110618880 00000100:00100000:0.0:1788586923.150916:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110618880 00000100:00100000:0.0:1788586923.150991:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 289 00000100:00100000:0.0:1788586923.151002:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+11:8721:x1875469110618880:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788586923.151496:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+11:8721:x1875469110618880:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 495us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.151505:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 289 00000100:00100000:2.0:1788586923.165131:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.165499:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619008 00000100:00100000:3.0:1788586923.165508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619008 00000100:00100000:3.0:1788586923.165568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 290 00000100:00100000:3.0:1788586923.165579:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+11:8721:x1875469110619008:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788586923.165729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+11:8721:x1875469110619008:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 151us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.165737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 290 00000100:00100000:2.0:1788586923.173322:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586923.173474:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619136 00000100:00100000:1.0:1788586923.173485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619136 00000100:00100000:1.0:1788586923.173545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 291 00000100:00100000:1.0:1788586923.173565:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+11:8717:x1875469110619136:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788586923.173583:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586923.173600:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd9958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c81071e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586923.173640:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd9958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81071e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586923.173652:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd9958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81071e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586923.173678:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030400, rc 0) 00000100:00100000:1.0:1788586923.173745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+12:8717:x1875469110619136:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 190us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.173752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 291 00000100:00100000:1.0:1788586923.177387:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.177502:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619264 00000100:00100000:0.0:1788586923.177512:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619264 00000100:00100000:0.0:1788586923.177564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 292 00000100:00100000:0.0:1788586923.177574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:8717:x1875469110619264:12345-192.168.203.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788586923.177600:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788586923.177622:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788586923.177631:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788586923.177634:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788586923.177637:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788586923.177639:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788586923.179895:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:8717:x1875469110619264:12345-192.168.203.1@tcp:256:mount.lustre.0 Request processed in 2313us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.179908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 292 00000100:00100000:2.0:1788586923.183032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.183387:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619392 00000100:00100000:0.0:1788586923.183398:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619392 00000100:00100000:0.0:1788586923.183483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 293 00000100:00100000:0.0:1788586923.183492:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+12:8717:x1875469110619392:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788586923.183508:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586923.183525:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810725 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586923.183551:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586923.183563:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586923.183572:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788586923.183631:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:8717:x1875469110619392:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 139us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.183639:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 293 00000100:00100000:1.0:1788586923.186508:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.186739:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619520 00000100:00100000:0.0:1788586923.186749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619520 00000100:00100000:0.0:1788586923.186802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 294 00000100:00100000:0.0:1788586923.186812:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:8717:x1875469110619520:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788586923.186988:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:8717:x1875469110619520:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 176us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.187006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 294 00000100:00100000:2.0:1788586923.188836:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586923.188940:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619648 00000100:00100000:1.0:1788586923.188949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619648 00000100:00100000:1.0:1788586923.189007:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 295 00000100:00100000:1.0:1788586923.189016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:8717:x1875469110619648:12345-192.168.203.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788586923.189344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:8717:x1875469110619648:12345-192.168.203.1@tcp:503:mount.lustre.0 Request processed in 328us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.189352:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 295 00000100:00100000:2.0:1788586923.195961:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.196171:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619776 00000100:00100000:3.0:1788586923.196181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619776 00000100:00100000:3.0:1788586923.196234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 296 00000100:00100000:3.0:1788586923.196245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:8728:x1875469110619776:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788586923.196467:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:8728:x1875469110619776:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 223us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.196476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 296 00000100:00100000:0.0:1788586923.205596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586923.205684:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110619904 00000100:00100000:1.0:1788586923.205694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110619904 00000100:00100000:1.0:1788586923.205747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 297 00000100:00100000:1.0:1788586923.205757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:8728:x1875469110619904:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788586923.205917:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:8728:x1875469110619904:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 160us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.205927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 297 00000100:00100000:2.0:1788586923.209577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586923.209607:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586923.209655:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.209744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620032 00000100:00100000:0.0:1788586923.209754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620032 00000100:00100000:0.0:1788586923.209795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620288 00000100:00100000:0.0:1788586923.209798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620288 00000100:00100000:0.0:1788586923.209820:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620160 00000100:00100000:0.0:1788586923.209822:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620160 00000100:00100000:0.0:1788586923.209839:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:0.0:1788586923.209848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110620288:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586923.209930:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110620288:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.209946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:0.0:1788586923.209964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00100000:0.0:1788586923.209969:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110620160:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586923.209993:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110620160:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.209999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00100000:0.0:1788586923.210009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:0.0:1788586923.210014:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1875469110620032:12345-192.168.203.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788586923.210035:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 398d2026-4c2a-4f38-a64f-9cac397cc1c6@192.168.203.1@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1788586923.210080:0:6521:0:(genops.c:1385:class_connect()) connect: client 398d2026-4c2a-4f38-a64f-9cac397cc1c6, cookie 0xfbc93bbea5fd9966 00000004:00100000:0.0:1788586923.210110:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788586923.210239:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb21800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586923.210270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2405:x1875469110620032:12345-192.168.203.1@tcp:38:mount.lustre.0 Request processed in 254us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.210277:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:2.0:1788586923.212308:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.213376:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620544 00000100:00100000:0.0:1788586923.213387:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620544 00000100:00100000:0.0:1788586923.213469:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:0.0:1788586923.213477:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1875469110620544:12345-192.168.203.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788586923.213512:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 398d2026-4c2a-4f38-a64f-9cac397cc1c6@192.168.203.1@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1788586923.213547:0:6521:0:(genops.c:1385:class_connect()) connect: client 398d2026-4c2a-4f38-a64f-9cac397cc1c6, cookie 0xfbc93bbea5fd996d 00000004:00100000:0.0:1788586923.213572:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788586923.213678:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb23000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586923.213795:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2405:x1875469110620544:12345-192.168.203.1@tcp:38:mount.lustre.0 Request processed in 316us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.213803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:1.0:1788586923.218796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.220481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620800 00000100:00100000:3.0:1788586923.220495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620800 00000100:00100000:3.0:1788586923.220568:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:3.0:1788586923.220578:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110620800:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788586923.220617:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586923.220705:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110620800:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 128us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.220713:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00080000:2.0:1788586923.220800:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586923.223780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586923.223872:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620416 00000100:00100000:1.0:1788586923.223882:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620416 00000100:00100000:1.0:1788586923.223945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:1.0:1788586923.223955:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:0:x1875469110620416:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788586923.224260:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788586923.224331:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:0:x1875469110620416:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 377us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.224339:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:2.0:1788586923.226553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.226792:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620672 00000100:00100000:3.0:1788586923.226802:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620672 00000100:00100000:3.0:1788586923.226873:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:3.0:1788586923.226883:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:0:x1875469110620672:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788586923.226920:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1788586923.227572:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586923.227678:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:0:x1875469110620672:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 794us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.227687:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:2.0:1788586923.227866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.228460:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110620928 00000100:00100000:3.0:1788586923.228469:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110620928 00000100:00100000:3.0:1788586923.228513:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788586923.228522:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110620928:12345-192.168.203.1@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788586923.228586:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110620928:12345-192.168.203.1@tcp:40:mount.lustre.0 Request processed in 65us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.228608:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:2.0:1788586923.231298:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586923.231434:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621056 00000100:00100000:0.0:1788586923.231443:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621056 00000100:00100000:0.0:1788586923.231491:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:0.0:1788586923.231498:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1875469110621056:12345-192.168.203.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788586923.231543:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 398d2026-4c2a-4f38-a64f-9cac397cc1c6@192.168.203.1@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:0.0:1788586923.231574:0:8436:0:(genops.c:1385:class_connect()) connect: client 398d2026-4c2a-4f38-a64f-9cac397cc1c6, cookie 0xfbc93bbea5fd9974 00002000:00100000:0.0:1788586923.231587:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 398d2026-4c2a-4f38-a64f-9cac397cc1c6/ffff8f5bbfb22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788586923.231603:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788586923.231675:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788586923.231716:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb22800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586923.231780:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2405:x1875469110621056:12345-192.168.203.1@tcp:8:mount.lustre.0 Request processed in 281us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.231788:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:0.0:1788586923.233626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.234704:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621184 00000100:00100000:3.0:1788586923.234715:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621184 00000100:00100000:3.0:1788586923.234766:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788586923.234773:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2405:x1875469110621184:12345-192.168.203.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788586923.234808:0:10047:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 398d2026-4c2a-4f38-a64f-9cac397cc1c6@192.168.203.1@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:3.0:1788586923.234836:0:10047:0:(genops.c:1385:class_connect()) connect: client 398d2026-4c2a-4f38-a64f-9cac397cc1c6, cookie 0xfbc93bbea5fd997b 00002000:00100000:3.0:1788586923.234847:0:10047:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 398d2026-4c2a-4f38-a64f-9cac397cc1c6/ffff8f5a81bcf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788586923.234873:0:10047:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788586923.234954:0:10047:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788586923.234982:0:10047:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc98a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586923.235709:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2405:x1875469110621184:12345-192.168.203.1@tcp:8:mount.lustre.0 Request processed in 932us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.235717:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:2.0:1788586923.235887:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586923.236521:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621312 00000100:00100000:3.0:1788586923.236530:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621312 00000100:00100000:3.0:1788586923.236610:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:3.0:1788586923.236622:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110621312:12345-192.168.203.1@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788586923.236722:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110621312:12345-192.168.203.1@tcp:900:mount.lustre.0 Request processed in 103us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.236729:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:1.0:1788586923.238899:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586923.239014:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621440 00000100:00100000:2.0:1788586923.239023:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621440 00000100:00100000:2.0:1788586923.239175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:2.0:1788586923.239186:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110621440:12345-192.168.203.1@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788586923.239273:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788586923.239358:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:8717:x1875469110621440:12345-192.168.203.1@tcp:33:mount.lustre.0 Request processed in 174us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586923.239365:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:2.0:1788586923.350107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586923.350128:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127464320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586923.350214:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586923.350287:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464320 00000100:00100000:2.0:1788586923.350295:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464320 00000100:00100000:2.0:1788586923.350350:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788586923.350360:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127464320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788586923.350384:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586923.350447:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127464320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586923.350454:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788586923.350494:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb02d80 x1875469127464320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586923.350532:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127464320:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788586923.350560:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586923.351677:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586923.351702:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127464448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586923.351750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.351899:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464448 00000100:00100000:1.0:1788586923.351906:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464448 00000100:00100000:1.0:1788586923.351962:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788586923.351969:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127464448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586923.351987:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586923.352026:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127464448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.352032:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788586923.352410:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127464704:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352463:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.352487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127465216:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352505:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.352517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127465728:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352533:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.352547:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788586923.352552:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127464832:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352571:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.352584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127465344:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352600:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.352615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127465856:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352645:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586923.352664:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464704 00000100:00100000:1.0:1788586923.352669:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464704 00000100:00100000:1.0:1788586923.352700:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465216 00000100:00100000:1.0:1788586923.352703:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465216 00000100:00100000:1.0:1788586923.352716:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465728 00000100:00100000:1.0:1788586923.352718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465728 00000100:00100000:1.0:1788586923.352728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465344 00000100:00100000:1.0:1788586923.352730:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465344 00000100:00100000:1.0:1788586923.352740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465856 00000100:00100000:1.0:1788586923.352743:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465856 00000100:00100000:1.0:1788586923.352755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586923.352772:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127464704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127464704:12345-0@lo:400:kworker.0 Request processed in 36us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.352813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586923.352824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788586923.352830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127465216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127465216:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.352858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788586923.352867:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586923.352872:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127465728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352895:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127465728:12345-0@lo:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.352901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586923.352911:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788586923.352917:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127465344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.352957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127465344:12345-0@lo:400:kworker.0 Request processed in 41us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.352963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788586923.352974:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788586923.352978:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127465856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.353000:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127465856:12345-0@lo:400:kworker.0 Request processed in 21us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.353005:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788586923.353035:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83770a80 x1875469127465344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586923.353047:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127465344:0@lo:400:kworker.0 00010000:00080000:1.0:1788586923.353057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83770e00 x1875469127465856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586923.353064:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127465856:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.353072:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83771180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127464704:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.353079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127465216:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.353086:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83771880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127465728:0@lo:400:kworker.0 00000100:00080000:0.0:1788586923.353581:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788586923.353586:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586923.353589:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586923.353602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127464576:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.353640:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586923.353696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127465088:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.353720:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586923.353736:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127465600:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.353753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788586923.353789:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83729f80 x1875469127464448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586923.353805:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127464448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586923.353820:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788586923.353826:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127464960:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.353848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586923.353862:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127465472:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.353882:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586923.353907:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465600 00000100:00100000:0.0:1788586923.353919:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465600 00000100:00100000:0.0:1788586923.353967:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465472 00000100:00100000:0.0:1788586923.353971:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465472 00000100:00100000:0.0:1788586923.353991:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788586923.353997:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127465600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.354037:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127465600:12345-0@lo:400:kworker.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.354044:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788586923.354057:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788586923.354062:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127465472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.354087:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127465472:12345-0@lo:400:kworker.0 Request processed in 25us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586923.354092:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788586923.354108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788586923.354123:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83771c00 x1875469127465472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586923.354133:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127465472:0@lo:400:kworker.0 00010000:00080000:0.0:1788586923.354142:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83773100 x1875469127465600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586923.354149:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127465600:0@lo:400:kworker.0 00000100:00100000:3.0:1788586923.354451:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464960 00000100:00100000:3.0:1788586923.354456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464960 00000100:00100000:3.0:1788586923.354479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788586923.354485:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127464960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586923.354540:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127464960:12345-0@lo:400:kworker.0 Request processed in 55us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586923.354546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788586923.354943:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464832 00000100:00100000:2.0:1788586923.354948:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464832 00000100:00100000:2.0:1788586923.354983:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465088 00000100:00100000:2.0:1788586923.354987:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465088 00000100:00100000:2.0:1788586923.355002:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788586923.355009:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127464832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586923.355055:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127464832:12345-0@lo:400:kworker.0 Request processed in 46us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586923.355061:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788586923.355073:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788586923.355079:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127465088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586923.355105:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127465088:12345-0@lo:400:kworker.0 Request processed in 27us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586923.355111:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788586923.355143:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127464832:0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.355311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127464576 00000100:00100000:1.0:1788586923.355316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127464576 00000100:00100000:1.0:1788586923.355350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788586923.355357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127464576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586923.355400:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127464576:12345-0@lo:400:kworker.0 Request processed in 44us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586923.355413:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788586923.355965:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127464960:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.355976:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127464576:0@lo:400:kworker.0 00000100:00100000:0.0:1788586923.355986:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127465088:0@lo:400:kworker.0 00010000:00010000:0.0:1788586923.476855:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586924.372666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127465984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586924.372706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127466112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586924.372745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586924.372781:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127465984 00000100:00100000:0.0:1788586924.372789:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127465984 00000100:00100000:1.0:1788586924.372825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586924.372936:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127466240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586924.372968:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586924.373001:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466240 00000100:00100000:2.0:1788586924.373004:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466240 00000100:00100000:2.0:1788586924.373034:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788586924.373043:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127466240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586924.373073:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586924.373111:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127466240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586924.373122:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788586924.373156:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127466240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788586924.376122:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466112 00000100:00100000:0.0:1788586924.376137:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466112 00000100:00100000:0.0:1788586924.376177:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586924.376186:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127465984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586924.376212:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586924.377220:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127465984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1013us (4455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586924.377232:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586924.377258:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586924.377277:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127466112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788586924.377294:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586924.377336:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127466112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586924.377342:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788586924.378299:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8700 x1875469127465984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586924.378326:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127465984:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788586924.378374:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83729f80 x1875469127466112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586924.378391:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127466112:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788586924.508197:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586925.524525:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586925.908924:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127466368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586925.909006:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586925.909166:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466368 00000100:00100000:2.0:1788586925.909175:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466368 00000100:00100000:2.0:1788586925.909228:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788586925.909237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127466368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586925.909269:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586925.909325:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127466368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586925.909332:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788586925.909402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127466368:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788586926.548867:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586927.574661:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586928.470801:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127466496:0@lo:400:kworker.0 00000100:00100000:3.0:1788586928.470997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.471473:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127466624:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.471511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.472078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127466752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586928.472119:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.472142:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586928.472147:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127466880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586928.472168:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.472196:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466752 00000100:00100000:0.0:1788586928.472202:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466752 00000100:00100000:0.0:1788586928.472244:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466880 00000100:00100000:0.0:1788586928.472247:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466880 00000100:00100000:0.0:1788586928.472264:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788586928.472272:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127466752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788586928.472310:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586928.472351:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127466752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.472358:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788586928.472374:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788586928.472380:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127466880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788586928.472390:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586928.472435:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127466880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.472441:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788586928.472456:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788586928.472481:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83595880 x1875469127466880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586928.472499:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127466880:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788586928.472509:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb01c00 x1875469127466752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586928.472534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127466752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586928.472750:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466496 00000100:00100000:3.0:1788586928.472756:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466496 00000100:00100000:3.0:1788586928.472793:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788586928.472799:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127466496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586928.472996:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127466496:12345-0@lo:400:kworker.0 Request processed in 196us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586928.473004:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788586928.473034:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127466624 00000100:00100000:3.0:1788586928.473038:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127466624 00000100:00100000:3.0:1788586928.473061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788586928.473067:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127466624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586928.473100:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127466624:12345-0@lo:400:kworker.0 Request processed in 33us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586928.473106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788586928.473479:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127466624:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.473505:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127466496:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.473651:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127467392:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.473687:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586928.473706:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127467904:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.473726:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586928.473745:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788586928.473750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127467264:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.473772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586928.473791:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127467776:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.473811:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.474056:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127467008:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474082:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.474101:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127467520:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474118:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.474133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127468032:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474151:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.474167:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788586928.474172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127467136:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474193:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586928.474204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127467648:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467392 00000100:00100000:0.0:1788586928.474233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467392 00000100:00100000:0.0:1788586928.474276:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467904 00000100:00100000:0.0:1788586928.474279:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467904 00000100:00100000:0.0:1788586928.474293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467520 00000100:00100000:0.0:1788586928.474296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467520 00000100:00100000:0.0:1788586928.474438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468032 00000100:00100000:0.0:1788586928.474442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468032 00000100:00100000:0.0:1788586928.474455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467136 00000100:00100000:0.0:1788586928.474458:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467136 00000100:00100000:0.0:1788586928.474470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788586928.474476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127467392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474527:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127467392:12345-0@lo:400:kworker.0 Request processed in 51us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.474535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788586928.474550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788586928.474556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127467904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474580:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127467904:12345-0@lo:400:kworker.0 Request processed in 24us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.474586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788586928.474596:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788586928.474602:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127467520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127467520:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.474633:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788586928.474644:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788586928.474649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127468032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474672:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127468032:12345-0@lo:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.474677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788586928.474688:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788586928.474693:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127467136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.474716:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127467136:12345-0@lo:400:kworker.0 Request processed in 23us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.474721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788586928.474740:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788586928.474744:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586928.475538:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127467392:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.475552:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127467904:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.475592:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467264 00000100:00100000:1.0:1788586928.475597:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467264 00000100:00100000:1.0:1788586928.475630:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467008 00000100:00100000:1.0:1788586928.475642:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467008 00000100:00100000:1.0:1788586928.475661:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788586928.475668:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127467264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.475717:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127467264:12345-0@lo:400:kworker.0 Request processed in 50us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586928.475724:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788586928.475736:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788586928.475741:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127467008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.475765:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127467008:12345-0@lo:400:kworker.0 Request processed in 25us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586928.475770:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788586928.475786:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467776 00000100:00100000:1.0:1788586928.475790:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467776 00000100:00100000:1.0:1788586928.476492:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788586928.476502:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127467776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.476542:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127467776:12345-0@lo:400:kworker.0 Request processed in 43us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586928.476548:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788586928.476586:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127467264:0@lo:400:kworker.0 00010000:00080000:1.0:1788586928.476598:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78000 x1875469127467776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586928.476608:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127467776:0@lo:400:kworker.0 00000100:00080000:1.0:1788586928.476629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586928.476644:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586928.476717:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127467008:0@lo:400:kworker.0 00010000:00080000:1.0:1788586928.476730:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8700 x1875469127467520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586928.476747:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127467520:0@lo:400:kworker.0 00010000:00080000:1.0:1788586928.476759:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca79c00 x1875469127468032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586928.476768:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127468032:0@lo:400:kworker.0 00000100:00100000:1.0:1788586928.476787:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127467136:0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.479090:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127467648 00000100:00100000:0.0:1788586928.479102:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127467648 00000100:00100000:0.0:1788586928.479212:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788586928.479223:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127467648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586928.479482:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127467648:12345-0@lo:400:kworker.0 Request processed in 259us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.479489:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788586928.479531:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca79500 x1875469127467648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586928.479556:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127467648:0@lo:400:kworker.0 00000100:00080000:1.0:1788586928.488157:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788586928.538957:0:12187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788586928.597542:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586928.745104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586928.745148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586928.745372:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621568 00000100:00100000:2.0:1788586928.745383:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621568 00000100:00100000:0.0:1788586928.745923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586928.746008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 300 00000100:00100000:2.0:1788586928.746030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110621568:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586928.746107:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110621568:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 81us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586928.746114:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 300 00000100:00100000:3.0:1788586928.748145:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621824 00000100:00100000:1.0:1788586928.748145:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622080 00000100:00100000:3.0:1788586928.748160:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621824 00000100:00100000:1.0:1788586928.748160:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622080 00000100:00100000:1.0:1788586928.748318:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00100000:1.0:1788586928.748331:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110622080:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586928.748403:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110622080:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 75us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586928.748412:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00100000:3.0:1788586928.748480:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586928.748508:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622336 00000100:00100000:3.0:1788586928.748512:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622336 00000100:00080000:0.0:1788586928.749568:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586928.749575:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788586928.750775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 118 00000100:00100000:2.0:1788586928.750788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110621824:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586928.751133:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110621824:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 348us (5983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586928.751139:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 118 00000100:00100000:2.0:1788586928.751927:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586928.752192:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586928.752223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586928.752260:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622208 00000100:00100000:2.0:1788586928.752268:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622208 00000100:00100000:2.0:1788586928.752484:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:2.0:1788586928.752504:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110622208:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586928.752634:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110622208:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 141us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586928.752642:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:2.0:1788586928.752800:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621696 00000100:00100000:2.0:1788586928.752805:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621696 00000100:00080000:0.0:1788586928.752930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586928.752935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788586928.752969:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110621952 00000100:00100000:2.0:1788586928.752973:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110621952 00000100:00080000:1.0:1788586928.754643:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586928.754884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 119 00000100:00100000:0.0:1788586928.754911:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110621696:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586928.754997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110621696:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 103us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.755020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 119 00000100:00100000:0.0:1788586928.755044:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 120 00000100:00100000:0.0:1788586928.755051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110621952:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586928.755077:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110621952:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 26us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586928.755101:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 120 00000100:00100000:3.0:1788586928.760310:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:3.0:1788586928.760328:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110622336:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586928.760905:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110622336:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 572us (12416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586928.760914:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 49 00000001:00100000:2.0:1788586928.985181:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000001:00100000:1.0:1788586928.988306:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000001:00100000:0.0:1788586928.989664:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000001:00100000:3.0:1788586928.994375:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000100:00100000:0.0:1788586929.492662:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127468160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586929.492742:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586929.493131:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468160 00000100:00100000:0.0:1788586929.493141:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468160 00000100:00100000:0.0:1788586929.493194:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788586929.493203:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127468160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586929.493232:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586929.493280:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127468160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586929.493287:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788586929.493323:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83596300 x1875469127468160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586929.493341:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127468160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586929.493771:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586929.493823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127468288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586929.493858:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586929.494105:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468288 00000100:00100000:0.0:1788586929.494111:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468288 00000100:00100000:0.0:1788586929.494149:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788586929.494157:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127468288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788586929.494172:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586929.494207:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127468288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586929.494214:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788586929.494326:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83596300 x1875469127468288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586929.494341:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127468288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586929.497345:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586929.497366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127468416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586929.497448:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.497499:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468416 00000100:00100000:3.0:1788586929.497506:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468416 00000100:00100000:3.0:1788586929.497549:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788586929.497558:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127468416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788586929.497597:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586929.497639:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127468416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.497646:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788586929.497687:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127468416:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788586929.621538:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586930.645685:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586931.031548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127468544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586931.031659:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586931.031735:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468544 00000100:00100000:3.0:1788586931.031743:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468544 00000100:00100000:3.0:1788586931.031786:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788586931.031794:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127468544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586931.031830:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586931.031875:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127468544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586931.031892:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788586931.031937:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127468544:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788586931.668957:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586932.697722:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586933.589802:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586933.589883:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586933.589956:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468800 00000100:00100000:2.0:1788586933.589964:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468800 00000100:00100000:2.0:1788586933.590033:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788586933.590044:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127468800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586933.590074:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586933.590120:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127468800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586933.590126:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788586933.590156:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788586933.590186:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb01c00 x1875469127468800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586933.590234:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586933.590602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586933.590658:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586933.590790:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468672 00000100:00100000:2.0:1788586933.590795:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468672 00000100:00100000:2.0:1788586933.590839:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788586933.590847:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127468672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788586933.590860:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586933.590908:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127468672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586933.590915:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788586933.590943:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83594700 x1875469127468672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586933.590958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127468672:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788586933.591715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586933.592392:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127469056:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.592581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127468928:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.592617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586933.592820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.592898:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127469440:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.592928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.592946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127469952:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.592968:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.593003:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788586933.593009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127469312:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.593031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.593048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127469824:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.593088:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.593124:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127468928 00000100:00100000:0.0:1788586933.593131:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127468928 00000100:00100000:0.0:1788586933.593185:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788586933.593194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127468928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.593261:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127468928:12345-0@lo:400:kworker.0 Request processed in 68us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.593269:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788586933.593298:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469440 00000100:00100000:0.0:1788586933.593302:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469440 00000100:00100000:0.0:1788586933.593325:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788586933.593332:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127469440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.593363:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127469440:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.593377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788586933.593413:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127468928:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.593443:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127469440:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.597607:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469056 00000100:00100000:0.0:1788586933.597633:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469056 00000100:00100000:0.0:1788586933.597684:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469312 00000100:00100000:0.0:1788586933.597688:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469312 00000100:00100000:0.0:1788586933.597714:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788586933.597725:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127469056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.597809:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127469056:12345-0@lo:400:kworker.0 Request processed in 86us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.597816:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788586933.597833:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788586933.597840:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127469312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.597886:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127469312:12345-0@lo:400:kworker.0 Request processed in 47us (4854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.597892:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788586933.597912:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469952 00000100:00100000:0.0:1788586933.597916:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469952 00000100:00100000:0.0:1788586933.597953:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469824 00000100:00100000:0.0:1788586933.597956:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469824 00000100:00100000:0.0:1788586933.597990:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586933.597998:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127469952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.598031:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127469952:12345-0@lo:400:kworker.0 Request processed in 35us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.598038:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586933.598060:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586933.598066:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127469824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.598097:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127469824:12345-0@lo:400:kworker.0 Request processed in 31us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.598103:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586933.598167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127469312:0@lo:400:kworker.0 00010000:00080000:0.0:1788586933.598182:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81090a80 x1875469127469824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586933.598192:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127469824:0@lo:400:kworker.0 00010000:00080000:0.0:1788586933.598210:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81092680 x1875469127469952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586933.598219:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127469952:0@lo:400:kworker.0 00000100:00080000:0.0:1788586933.599580:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586933.599601:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127469184:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.599725:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.599810:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127469696:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.599836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.599855:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127470208:0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.599889:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.599925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469696 00000100:00100000:0.0:1788586933.599932:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469696 00000100:00100000:0.0:1788586933.599983:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470208 00000100:00100000:0.0:1788586933.599986:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470208 00000100:00100000:0.0:1788586933.600007:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788586933.600015:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127469696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.600069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127469696:12345-0@lo:400:kworker.0 Request processed in 55us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.600077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788586933.600092:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788586933.600098:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127470208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.600125:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127470208:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.600131:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788586933.600160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788586933.600184:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83666a00 x1875469127469696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586933.600197:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127469696:0@lo:400:kworker.0 00010000:00080000:0.0:1788586933.600207:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81093100 x1875469127470208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586933.600227:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127470208:0@lo:400:kworker.0 00000100:00100000:2.0:1788586933.601701:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127469056:0@lo:400:kworker.0 00000100:00100000:2.0:1788586933.602240:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127469568:0@lo:400:kworker.0 00000100:00100000:2.0:1788586933.602297:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586933.602334:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469568 00000100:00100000:2.0:1788586933.602340:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469568 00000100:00100000:2.0:1788586933.602538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788586933.602548:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127469568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586933.603102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127469568:12345-0@lo:400:kworker.0 Request processed in 553us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586933.603120:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788586933.603150:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586933.603181:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127469568:0@lo:400:kworker.0 00000100:00100000:2.0:1788586933.603192:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127470080:0@lo:400:kworker.0 00000100:00100000:2.0:1788586933.603216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586933.603342:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470080 00000100:00100000:0.0:1788586933.603348:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470080 00000100:00100000:0.0:1788586933.603396:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788586933.603404:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127470080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586933.603499:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127470080:12345-0@lo:400:kworker.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.603506:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788586933.604105:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586933.604134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127470080:0@lo:400:kworker.0 00000100:00100000:1.0:1788586933.604340:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127469184 00000100:00100000:1.0:1788586933.604346:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127469184 00000100:00100000:1.0:1788586933.604512:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788586933.604520:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127469184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586933.604579:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127469184:12345-0@lo:400:kworker.0 Request processed in 60us (4854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586933.604586:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788586933.605044:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127469184:0@lo:400:kworker.0 00010000:00010000:1.0:1788586933.725075:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586933.868284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868579:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868648:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586933.868672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622720 00000100:00100000:3.0:1788586933.868681:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622720 00000100:00100000:3.0:1788586933.868727:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622976 00000100:00100000:3.0:1788586933.868730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622976 00000100:00100000:3.0:1788586933.868740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622592 00000100:00100000:3.0:1788586933.868742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622592 00000100:00100000:3.0:1788586933.868752:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622848 00000100:00100000:3.0:1788586933.868754:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622848 00000100:00100000:3.0:1788586933.868766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:3.0:1788586933.868775:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110622720:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586933.868918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110622720:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 143us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586933.868926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:3.0:1788586933.868942:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:3.0:1788586933.868948:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110622976:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586933.868968:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110622976:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 20us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586933.868982:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:3.0:1788586933.868992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 129 00000100:00100000:3.0:1788586933.868998:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110622592:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586933.869015:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110622592:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 17us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586933.869020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 129 00000100:00100000:3.0:1788586933.869028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 130 00000100:00100000:3.0:1788586933.869033:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110622848:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586933.869048:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110622848:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 15us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586933.869053:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 130 00000100:00080000:3.0:1788586933.869067:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586933.869070:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586933.872464:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623232 00000100:00100000:1.0:1788586933.872482:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623232 00000100:00100000:1.0:1788586933.872546:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623104 00000100:00100000:1.0:1788586933.872549:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623104 00000100:00100000:1.0:1788586933.872577:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:1.0:1788586933.872586:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110623232:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586933.872660:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110623232:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 75us (4060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586933.872668:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:1.0:1788586933.872685:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:1.0:1788586933.872692:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110623104:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586933.872713:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110623104:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 23us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586933.872719:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00080000:3.0:1788586933.873372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586933.873377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586933.874950:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110622464 00000100:00100000:0.0:1788586933.874964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110622464 00000100:00100000:0.0:1788586933.875048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 302 00000100:00100000:0.0:1788586933.875065:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110622464:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586933.875134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110622464:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 71us (6860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586933.875142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 302 00000100:00100000:3.0:1788586934.613543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127470336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586934.613614:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586934.613694:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586934.613701:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127470464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586934.613725:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586934.613759:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470336 00000100:00100000:3.0:1788586934.613768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470336 00000100:00100000:3.0:1788586934.613827:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788586934.613837:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127470336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788586934.613877:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586934.613920:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127470336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586934.613927:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788586934.613948:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470464 00000100:00100000:3.0:1788586934.613952:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470464 00000100:00100000:3.0:1788586934.614140:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788586934.614147:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127470464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788586934.614167:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586934.614197:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127470464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586934.614203:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788586934.614241:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a1f80 x1875469127470464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586934.614462:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127470592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586934.614492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586934.614763:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127470464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586934.614848:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127470336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586934.614887:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470592 00000100:00100000:3.0:1788586934.614891:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470592 00000100:00100000:3.0:1788586934.614926:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788586934.614939:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127470592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586934.614952:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586934.615162:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127470592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586934.615169:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788586934.617545:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a834a3100 x1875469127470592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586934.617569:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127470592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788586934.749260:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788586935.111974:0:12502:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788586935.112280:0:12502:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788586935.770630:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586936.153604:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127470720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586936.153676:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586936.153782:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470720 00000100:00100000:3.0:1788586936.153790:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470720 00000100:00100000:3.0:1788586936.153843:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788586936.153863:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127470720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586936.153894:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586936.153977:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127470720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586936.153984:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788586936.154026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127470720:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788586936.788950:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788586936.973306:0:12600:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788586936.974354:0:12600:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788586937.814796:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586938.711682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127471232:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.711762:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.711821:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127471744:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.711856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.711880:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127472256:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.711911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.711934:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788586938.711940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127471104:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.711967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.711988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127471616:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.712009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.712025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127472128:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.712046:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.712062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127472640:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.712081:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586938.712109:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471232 00000100:00100000:1.0:1788586938.712116:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471232 00000100:00100000:1.0:1788586938.712156:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471744 00000100:00100000:1.0:1788586938.712159:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471744 00000100:00100000:1.0:1788586938.712181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472256 00000100:00100000:1.0:1788586938.712185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472256 00000100:00100000:1.0:1788586938.712199:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788586938.712205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127471232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.712257:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127471232:12345-0@lo:400:kworker.0 Request processed in 52us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.712264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788586938.712279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788586938.712286:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127471744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.712310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127471744:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.712316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788586938.712334:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788586938.712340:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127472256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.712368:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127472256:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.712374:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788586938.712396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471104 00000100:00100000:1.0:1788586938.712399:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471104 00000100:00100000:3.0:1788586938.712551:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127470848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586938.712584:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127471360:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.712624:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712640:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127471872:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.712658:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712674:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127472384:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.712702:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712721:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788586938.712727:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127470976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586938.712749:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712767:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127471488:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.712803:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712821:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127472000:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.712850:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712866:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127472512:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.712883:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586938.712912:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470848 00000100:00100000:3.0:1788586938.712915:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470848 00000100:00100000:3.0:1788586938.712937:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127470976 00000100:00100000:3.0:1788586938.712939:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127470976 00000100:00100000:3.0:1788586938.712953:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788586938.712959:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127470848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788586938.712981:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586938.713017:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127470848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.713022:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788586938.713035:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788586938.713040:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127470976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788586938.713048:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586938.713072:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127470976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.713077:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788586938.713102:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471616 00000100:00100000:3.0:1788586938.713106:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471616 00000100:00100000:3.0:1788586938.713128:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471360 00000100:00100000:3.0:1788586938.713130:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471360 00000100:00100000:3.0:1788586938.713141:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788586938.713147:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127471616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.713179:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127471616:12345-0@lo:400:kworker.0 Request processed in 33us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.713184:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788586938.713194:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788586938.713199:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127471360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.713221:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127471360:12345-0@lo:400:kworker.0 Request processed in 23us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.713226:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788586938.713243:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472128 00000100:00100000:3.0:1788586938.713247:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472128 00000100:00100000:3.0:1788586938.713264:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472640 00000100:00100000:3.0:1788586938.713266:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472640 00000100:00100000:3.0:1788586938.713274:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472000 00000100:00100000:3.0:1788586938.713276:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472000 00000100:00100000:3.0:1788586938.713287:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472512 00000100:00100000:3.0:1788586938.713289:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472512 00000100:00100000:3.0:1788586938.713299:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788586938.713304:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127472128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.713332:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127472128:12345-0@lo:400:kworker.0 Request processed in 28us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.713338:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788586938.713348:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788586938.713353:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127472640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.713388:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127472640:12345-0@lo:400:kworker.0 Request processed in 34us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.713394:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788586938.713405:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788586938.713410:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127472000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.713781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788586938.713791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127471104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.713825:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127471104:12345-0@lo:400:kworker.0 Request processed in 38us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.713840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788586938.713875:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586938.713882:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127472512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.713910:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127472512:12345-0@lo:400:kworker.0 Request processed in 29us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.713916:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788586938.713938:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471872 00000100:00100000:1.0:1788586938.713942:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471872 00000100:00100000:1.0:1788586938.713966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472384 00000100:00100000:1.0:1788586938.713968:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472384 00000100:00100000:1.0:1788586938.713980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127471488 00000100:00100000:1.0:1788586938.713983:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127471488 00000100:00100000:1.0:1788586938.713994:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788586938.714000:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127471872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714028:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127471872:12345-0@lo:400:kworker.0 Request processed in 28us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.714045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788586938.714057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788586938.714063:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127472384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714090:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127472384:12345-0@lo:400:kworker.0 Request processed in 28us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.714095:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788586938.714105:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788586938.714111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127471488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127471488:12345-0@lo:400:kworker.0 Request processed in 25us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.714141:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788586938.714156:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788586938.714160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788586938.714162:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586938.714164:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586938.714204:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127471104:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127471616:0@lo:400:kworker.0 00010000:00080000:1.0:1788586938.714229:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf9180 x1875469127472128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586938.714238:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127472128:0@lo:400:kworker.0 00010000:00080000:1.0:1788586938.714248:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf9f80 x1875469127472640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586938.714256:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127472640:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127471232:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714303:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127471744:0@lo:400:kworker.0 00000100:00100000:1.0:1788586938.714312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127472256:0@lo:400:kworker.0 00000100:00100000:3.0:1788586938.714951:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127472000:12345-0@lo:400:kworker.0 Request processed in 1540us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586938.714960:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788586938.714999:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7aa6d80 x1875469127470976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586938.715017:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127470976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586938.715030:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127471488:0@lo:400:kworker.0 00010000:00080000:3.0:1788586938.715041:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca79880 x1875469127472000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586938.715049:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127472000:0@lo:400:kworker.0 00010000:00080000:3.0:1788586938.715059:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8e00 x1875469127472512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586938.715067:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127472512:0@lo:400:kworker.0 00010000:00080000:3.0:1788586938.715077:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81090a80 x1875469127470848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586938.715087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127470848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586938.715097:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127471360:0@lo:400:kworker.0 00010000:00080000:3.0:1788586938.715131:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78000 x1875469127471872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586938.715147:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127471872:0@lo:400:kworker.0 00010000:00080000:3.0:1788586938.715158:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbfb800 x1875469127472384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586938.715166:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127472384:0@lo:400:kworker.0 00010000:00010000:2.0:1788586938.837605:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788586938.876198:0:12697:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788586938.876736:0:12697:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788586938.991095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991137:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991221:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586938.991288:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624000 00000100:00100000:1.0:1788586938.991297:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624000 00000100:00100000:1.0:1788586938.991350:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624128 00000100:00100000:1.0:1788586938.991354:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624128 00000100:00100000:1.0:1788586938.991376:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:1.0:1788586938.991385:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624000:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991473:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624000:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991480:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:1.0:1788586938.991495:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:1.0:1788586938.991502:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624128:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991526:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624128:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991531:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:1.0:1788586938.991548:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623360 00000100:00100000:1.0:1788586938.991551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623360 00000100:00100000:1.0:1788586938.991585:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 304 00000100:00100000:1.0:1788586938.991592:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110623360:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110623360:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991624:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 304 00000100:00100000:1.0:1788586938.991650:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623488 00000100:00100000:1.0:1788586938.991653:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623488 00000100:00100000:1.0:1788586938.991674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623744 00000100:00100000:1.0:1788586938.991677:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623744 00000100:00100000:1.0:1788586938.991687:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623616 00000100:00100000:1.0:1788586938.991690:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623616 00000100:00100000:1.0:1788586938.991701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110623872 00000100:00100000:1.0:1788586938.991703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110623872 00000100:00100000:1.0:1788586938.991717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:1.0:1788586938.991722:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110623488:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991765:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110623488:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 41us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:1.0:1788586938.991783:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 138 00000100:00100000:1.0:1788586938.991789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110623744:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991810:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110623744:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 138 00000100:00100000:1.0:1788586938.991840:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 139 00000100:00100000:1.0:1788586938.991846:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110623616:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110623616:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 24us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991882:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 139 00000100:00100000:1.0:1788586938.991896:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 140 00000100:00100000:1.0:1788586938.991902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110623872:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586938.991941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110623872:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 40us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586938.991949:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 140 00000100:00080000:1.0:1788586938.991973:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788586938.991976:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788586938.991979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586938.991981:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586939.734100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127472768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586939.734191:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586939.734257:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127472896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586939.734287:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586939.734321:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472768 00000100:00100000:3.0:1788586939.734328:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472768 00000100:00100000:3.0:1788586939.734366:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127472896 00000100:00100000:3.0:1788586939.734369:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127472896 00000100:00100000:3.0:1788586939.734383:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788586939.734391:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127472768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586939.734444:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586939.734489:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127472768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586939.734496:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788586939.734513:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788586939.734518:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127472896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788586939.734527:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586939.734553:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127472896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586939.734564:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788586939.734598:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81090a80 x1875469127472896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586939.734615:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127472896:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788586939.734640:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a827a0a80 x1875469127472768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586939.734651:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127472768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586939.734752:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586939.734760:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127473024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586939.734788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586939.734819:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473024 00000100:00100000:1.0:1788586939.734833:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473024 00000100:00100000:1.0:1788586939.734861:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788586939.734867:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127473024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788586939.734891:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788586939.734923:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127473024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586939.734929:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788586939.734957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127473024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788586939.860540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586940.884594:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788586940.956960:0:12794:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788586940.957671:0:12794:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788586941.269682:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127473152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586941.269761:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586941.269867:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473152 00000100:00100000:3.0:1788586941.269876:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473152 00000100:00100000:3.0:1788586941.269933:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788586941.269943:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb06f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127473152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586941.269981:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586941.270034:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb06f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127473152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586941.270042:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788586941.270345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127473152:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788586941.910575:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586942.935333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788586942.997789:0:12892:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788586942.998186:0:12892:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788586943.828628:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127473408:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.828704:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.828764:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127473920:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.828787:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.828819:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127474432:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.828840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.828862:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788586943.828868:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127473536:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.828891:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.829158:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127474048:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829181:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.829196:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127474560:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829213:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.829238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473408 00000100:00100000:1.0:1788586943.829245:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473408 00000100:00100000:1.0:1788586943.829285:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473920 00000100:00100000:1.0:1788586943.829288:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473920 00000100:00100000:1.0:1788586943.829309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474432 00000100:00100000:1.0:1788586943.829312:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474432 00000100:00100000:1.0:1788586943.829323:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474048 00000100:00100000:1.0:1788586943.829324:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474048 00000100:00100000:1.0:1788586943.829334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474560 00000100:00100000:1.0:1788586943.829336:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474560 00000100:00100000:1.0:1788586943.829350:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788586943.829357:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127473408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127473408:12345-0@lo:400:kworker.0 Request processed in 46us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586943.829410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788586943.829458:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788586943.829464:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127473920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829493:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127473920:12345-0@lo:400:kworker.0 Request processed in 30us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586943.829499:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788586943.829509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788586943.829515:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127474432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829538:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127474432:12345-0@lo:400:kworker.0 Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586943.829543:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788586943.829553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788586943.829559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127474048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829582:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127474048:12345-0@lo:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586943.829588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788586943.829598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788586943.829603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127474560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.829628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127474560:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586943.829633:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788586943.829653:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473536 00000100:00100000:1.0:1788586943.829657:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473536 00000100:00100000:1.0:1788586943.829678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788586943.829684:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127473536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.829829:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127473664:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.829861:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.829882:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127474176:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.829914:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.829932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127474688:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.829951:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.829968:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788586943.829974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127473280:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.829997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.830017:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127473792:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830038:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.830050:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127474304:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830066:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.830081:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127474816:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.830130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473664 00000100:00100000:0.0:1788586943.830134:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473664 00000100:00100000:0.0:1788586943.830158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788586943.830165:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127473664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830199:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127473664:12345-0@lo:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830204:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788586943.830220:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473792 00000100:00100000:0.0:1788586943.830224:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473792 00000100:00100000:0.0:1788586943.830237:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586943.830243:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127473792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830269:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127473792:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830275:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586943.830291:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474176 00000100:00100000:0.0:1788586943.830295:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474176 00000100:00100000:0.0:1788586943.830311:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474688 00000100:00100000:0.0:1788586943.830313:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474688 00000100:00100000:0.0:1788586943.830323:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474304 00000100:00100000:0.0:1788586943.830325:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474304 00000100:00100000:0.0:1788586943.830334:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474816 00000100:00100000:0.0:1788586943.830336:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474816 00000100:00100000:0.0:1788586943.830349:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788586943.830355:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127474176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830383:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127474176:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830389:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788586943.830398:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788586943.830404:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127474688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830472:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127474688:12345-0@lo:400:kworker.0 Request processed in 68us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830478:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788586943.830489:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788586943.830494:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127474304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830515:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127474304:12345-0@lo:400:kworker.0 Request processed in 21us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830521:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788586943.830529:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788586943.830534:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127474816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830553:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127474816:12345-0@lo:400:kworker.0 Request processed in 20us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830559:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788586943.830575:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127473280 00000100:00100000:0.0:1788586943.830578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127473280 00000100:00100000:0.0:1788586943.830602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788586943.830608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127473280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127473280:12345-0@lo:400:kworker.0 Request processed in 29us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.830644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788586943.830708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127473280:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127473792:0@lo:400:kworker.0 00010000:00080000:0.0:1788586943.830745:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8380 x1875469127474304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586943.830767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127474304:0@lo:400:kworker.0 00010000:00080000:0.0:1788586943.830778:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8700 x1875469127474816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586943.830786:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127474816:0@lo:400:kworker.0 00000100:00100000:0.0:1788586943.830806:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127473664:0@lo:400:kworker.0 00010000:00080000:0.0:1788586943.830815:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf9880 x1875469127474176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586943.830822:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127474176:0@lo:400:kworker.0 00010000:00080000:0.0:1788586943.830831:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbf8e00 x1875469127474688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586943.830839:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127474688:0@lo:400:kworker.0 00000100:00100000:3.0:1788586943.831159:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586943.831171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127474944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586943.831203:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586943.831234:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127474944 00000100:00100000:3.0:1788586943.831244:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127474944 00000100:00100000:3.0:1788586943.831272:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788586943.831277:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127474944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788586943.831298:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586943.831333:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127474944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586943.831339:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788586943.831368:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83606680 x1875469127474944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586943.831381:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127474944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788586943.831409:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586943.831437:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586943.831440:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788586943.831443:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788586943.831469:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127473536:0@lo:400:kworker.0 00010000:00080000:3.0:1788586943.831481:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a837e6300 x1875469127474048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586943.831491:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127474048:0@lo:400:kworker.0 00010000:00080000:3.0:1788586943.831502:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbfb800 x1875469127474560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586943.831511:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127474560:0@lo:400:kworker.0 00000100:00100000:3.0:1788586943.831523:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127473408:0@lo:400:kworker.0 00000100:00100000:3.0:1788586943.831535:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127473920:0@lo:400:kworker.0 00000100:00100000:3.0:1788586943.831545:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127474432:0@lo:400:kworker.0 00000100:00100000:1.0:1788586943.831635:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127473536:12345-0@lo:400:kworker.0 Request processed in 1950us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586943.831650:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788586943.832071:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586943.832081:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127475072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586943.832112:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586943.832527:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475072 00000100:00100000:0.0:1788586943.832532:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475072 00000100:00100000:0.0:1788586943.832569:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788586943.832577:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127475072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788586943.832592:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586943.832640:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127475072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.832647:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788586943.832783:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a834a2300 x1875469127475072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586943.832809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127475072:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788586943.956577:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586944.104077:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104215:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104257:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586944.104287:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624512 00000100:00100000:2.0:1788586944.104297:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624512 00000100:00100000:2.0:1788586944.104345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624768 00000100:00100000:2.0:1788586944.104348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624768 00000100:00100000:2.0:1788586944.104363:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624384 00000100:00100000:2.0:1788586944.104375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624384 00000100:00100000:2.0:1788586944.104391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624640 00000100:00100000:2.0:1788586944.104393:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624640 00000100:00100000:2.0:1788586944.104409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 147 00000100:00100000:2.0:1788586944.104435:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110624512:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586944.104506:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110624512:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 88us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.104513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 147 00000100:00100000:2.0:1788586944.104529:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 148 00000100:00100000:2.0:1788586944.104535:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624768:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586944.104558:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624768:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.104564:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 148 00000100:00100000:2.0:1788586944.104574:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 149 00000100:00100000:2.0:1788586944.104579:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110624384:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586944.104599:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110624384:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 20us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.104605:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 149 00000100:00100000:2.0:1788586944.104615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 150 00000100:00100000:2.0:1788586944.104633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624640:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586944.104658:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110624640:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.104665:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 150 00000100:00100000:2.0:1788586944.104685:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624896 00000100:00100000:3.0:1788586944.105112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110624256 00000100:00100000:3.0:1788586944.105117:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624256 00000100:00100000:3.0:1788586944.105152:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 306 00000100:00100000:3.0:1788586944.105158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110624256:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586944.105187:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110624256:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 29us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.105194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 306 00000100:00080000:3.0:1788586944.105222:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586944.105226:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586944.105251:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625024 00000100:00100000:3.0:1788586944.105254:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625024 00000100:00100000:3.0:1788586944.105283:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:3.0:1788586944.105290:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2405:x1875469110625024:12345-192.168.203.1@tcp:9:kworker.0 00000020:00000080:3.0:1788586944.105308:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd997b 00000100:00080000:3.0:1788586944.105317:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc98a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788586944.105363:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788586944.105509:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+2:2405:x1875469110625024:12345-192.168.203.1@tcp:9:kworker.0 Request processed in 218us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.105516:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00010000:00010000:3.0:1788586944.105536:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788586944.105542:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586944.109024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110624896 00000100:00100000:2.0:1788586944.109131:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:2.0:1788586944.109142:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2405:x1875469110624896:12345-192.168.203.1@tcp:9:kworker.0 00000020:00000080:2.0:1788586944.109169:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9974 00000100:00080000:2.0:1788586944.109179:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb22800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788586944.109227:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788586944.109380:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+2:2405:x1875469110624896:12345-192.168.203.1@tcp:9:kworker.0 Request processed in 239us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.109388:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00010000:00010000:2.0:1788586944.109412:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788586944.109585:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586944.852670:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127475200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788586944.852741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.852870:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475200 00000100:00100000:1.0:1788586944.852879:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475200 00000100:00100000:1.0:1788586944.852939:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788586944.852950:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127475200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788586944.852982:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788586944.853032:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127475200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.853038:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788586944.853091:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127475200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586944.853688:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586944.853700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127475328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586944.853736:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.853771:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475328 00000100:00100000:1.0:1788586944.853776:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475328 00000100:00100000:1.0:1788586944.853819:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788586944.853826:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127475328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788586944.853847:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586944.853881:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127475328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.853887:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788586944.853932:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78000 x1875469127475328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586944.853946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127475328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586944.856413:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127475456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586944.856538:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.856797:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475456 00000100:00100000:2.0:1788586944.856806:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475456 00000100:00100000:3.0:1788586944.857151:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788586944.857163:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127475456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586944.857183:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586944.857240:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127475456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.857246:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788586944.857310:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a834a3800 x1875469127475456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586944.857328:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127475456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788586944.981523:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586946.005241:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586946.389453:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586946.389477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127475584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586946.389543:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586946.396488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475584 00000100:00100000:1.0:1788586946.396500:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475584 00000100:00100000:1.0:1788586946.396551:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788586946.396561:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127475584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788586946.396597:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788586946.396993:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127475584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 431us (7448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586946.397000:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788586946.398495:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127475584:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788586946.628883:0:13036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788586947.028573:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586948.052582:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586948.949623:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127475712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586948.949698:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.949753:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586948.949771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586948.949798:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.949839:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475712 00000100:00100000:1.0:1788586948.949846:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475712 00000100:00100000:1.0:1788586948.949892:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475840 00000100:00100000:1.0:1788586948.949895:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475840 00000100:00100000:1.0:1788586948.949913:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788586948.949921:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127475712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788586948.949950:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586948.949994:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127475712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.950012:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788586948.950196:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788586948.950204:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127475840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586948.950214:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586948.950239:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127475840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.950245:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788586948.950281:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83605f80 x1875469127475840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586948.950299:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127475840:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788586948.950311:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78000 x1875469127475712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586948.950323:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127475712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586948.950745:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127475968:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.950793:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.950822:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127476480:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.950845:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.950865:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127476992:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.950886:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.950907:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788586948.950913:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127476096:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.950936:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.950955:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127476608:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.950984:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.951001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127477120:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.951020:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.951046:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476992 00000100:00100000:1.0:1788586948.951051:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476992 00000100:00100000:1.0:1788586948.951089:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788586948.951097:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127476992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.951133:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127476992:12345-0@lo:400:kworker.0 Request processed in 38us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.951139:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788586948.951157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476096 00000100:00100000:1.0:1788586948.951161:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476096 00000100:00100000:1.0:1788586948.951188:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476608 00000100:00100000:1.0:1788586948.951191:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476608 00000100:00100000:1.0:1788586948.951203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127477120 00000100:00100000:1.0:1788586948.951206:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127477120 00000100:00100000:1.0:1788586948.951218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788586948.951224:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127476096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.951252:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127476096:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.951259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788586948.951269:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788586948.951275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127476608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.951301:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127476608:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.951307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788586948.951318:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788586948.951332:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127477120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.951360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127477120:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.951366:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788586948.951393:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127476352:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.952051:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.952118:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127476864:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.952148:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.952169:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788586948.952175:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127476224:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.952195:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.952212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127476736:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.952231:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586948.952336:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127477248:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.952360:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586948.952409:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476352 00000100:00100000:2.0:1788586948.952434:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476352 00000100:00100000:2.0:1788586948.952479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476736 00000100:00100000:2.0:1788586948.952483:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476736 00000100:00100000:2.0:1788586948.952502:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788586948.952509:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127476352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586948.952549:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127476352:12345-0@lo:400:kworker.0 Request processed in 41us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586948.952556:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788586948.952571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788586948.952587:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127476736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586948.952614:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127476736:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586948.952627:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788586948.952647:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476864 00000100:00100000:2.0:1788586948.952650:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476864 00000100:00100000:2.0:1788586948.952680:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788586948.952686:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127476864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586948.952719:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127476864:12345-0@lo:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586948.952724:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788586948.952740:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476480 00000100:00100000:2.0:1788586948.952743:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476480 00000100:00100000:2.0:1788586948.952774:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127476224 00000100:00100000:2.0:1788586948.952778:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127476224 00000100:00100000:2.0:1788586948.952790:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788586948.952796:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127476480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586948.952828:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127476480:12345-0@lo:400:kworker.0 Request processed in 32us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586948.952834:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788586948.952846:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788586948.952851:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127476224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586948.952877:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127476224:12345-0@lo:400:kworker.0 Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586948.952883:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788586948.953141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127476352:0@lo:400:kworker.0 00010000:00080000:1.0:1788586948.953156:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82297b80 x1875469127476864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586948.953166:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127476864:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.953185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127476224:0@lo:400:kworker.0 00010000:00080000:1.0:1788586948.953194:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82294000 x1875469127476736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586948.953203:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127476736:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.953227:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127477248 00000100:00100000:1.0:1788586948.953230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127477248 00000100:00100000:1.0:1788586948.953251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788586948.953256:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127477248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.953291:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127477248:12345-0@lo:400:kworker.0 Request processed in 34us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586948.953297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788586948.953325:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127476096:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.953335:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127476608:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.953345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127477120:0@lo:400:kworker.0 00000100:00100000:1.0:1788586948.953354:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127476480:0@lo:400:kworker.0 00010000:00080000:1.0:1788586948.953364:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a82296680 x1875469127476992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586948.953373:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127476992:0@lo:400:kworker.0 00010000:00080000:1.0:1788586948.953395:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83c56d80 x1875469127477248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586948.953402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127477248:0@lo:400:kworker.0 00000100:00080000:0.0:1788586948.954050:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788586948.954055:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586948.954058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586948.954060:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586948.954070:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127475968 00000100:00100000:0.0:1788586948.954075:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127475968 00000100:00100000:0.0:1788586948.954112:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788586948.954118:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127475968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586948.954159:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127475968:12345-0@lo:400:kworker.0 Request processed in 41us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586948.954165:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788586948.954202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127475968:0@lo:400:kworker.0 00010000:00010000:0.0:1788586949.084514:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586949.228784:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586949.230122:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625280 00000100:00100000:1.0:1788586949.230134:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625280 00000100:00100000:1.0:1788586949.230256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 157 00000100:00100000:1.0:1788586949.230267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110625280:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586949.230346:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2406:x1875469110625280:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 80us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586949.230361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 157 00000100:00080000:0.0:1788586949.230680:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586949.231366:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586949.231954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586949.232047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586949.232093:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586949.232122:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625536 00000100:00100000:2.0:1788586949.232131:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625536 00000100:00100000:2.0:1788586949.232183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625408 00000100:00100000:2.0:1788586949.232186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625408 00000100:00100000:2.0:1788586949.232200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625664 00000100:00100000:2.0:1788586949.232214:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625664 00000100:00100000:2.0:1788586949.232233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 158 00000100:00100000:2.0:1788586949.232241:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110625536:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586949.232384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110625536:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 142us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586949.232392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 158 00000100:00100000:2.0:1788586949.232408:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 159 00000100:00100000:2.0:1788586949.232437:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110625408:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586949.232465:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110625408:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586949.232471:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 159 00000100:00100000:2.0:1788586949.232483:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 160 00000100:00100000:2.0:1788586949.232489:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110625664:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586949.232509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110625664:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 21us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586949.232515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 160 00000100:00080000:0.0:1788586949.232782:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788586949.232787:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586949.233182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625152 00000100:00100000:1.0:1788586949.233189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625152 00000100:00100000:1.0:1788586949.233271:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 308 00000100:00100000:1.0:1788586949.233280:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110625152:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586949.233338:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110625152:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 59us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586949.233345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 308 00000020:00000080:2.0:1788586949.590299:0:13184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf27f7420 20000000:00000080:2.0:1788586949.590319:0:13184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5bb5b3ac00 uarg=0000000000000000 20000000:01000000:2.0:1788586949.590359:0:13184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788586949.590366:0:13184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788586949.590377:0:13184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788586949.593071:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788586949.593328:0:13184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788586949.602824:0:13184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788586949.603095:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603115:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603125:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603132:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603139:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603145:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603152:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603159:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603276:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603290:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 12 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.603321:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477376:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586949.603511:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603520:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 23 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.603529:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477504:0@lo:104: 00000100:00100000:2.0:1788586949.603566:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586949.603598:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603606:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 23 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.603614:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477632:0@lo:104: 00000100:00100000:2.0:1788586949.603631:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586949.603649:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603668:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 23 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.603681:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477760:0@lo:104: 00000100:00100000:2.0:1788586949.603700:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586949.603714:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603732:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 23 pid: 6516 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.603740:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477888:0@lo:104: 00000100:00100000:2.0:1788586949.603770:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586949.603787:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586949.603795:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 12 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.603803:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127478016:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586949.603823:0:13184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788586949.603906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127477504 00000100:00100000:0.0:1788586949.603913:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127477504 00000100:00100000:0.0:1788586949.603958:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127477632 00000100:00100000:0.0:1788586949.603961:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127477632 00000100:00100000:0.0:1788586949.603970:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127477760 00000100:00100000:0.0:1788586949.603973:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127477760 00000100:00100000:0.0:1788586949.603980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127477888 00000100:00100000:0.0:1788586949.603987:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127477888 00000100:00100000:0.0:1788586949.604003:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586949.604013:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:13184:x1875469127477504:12345-0@lo:104: 00010000:00010000:0.0:1788586949.604025:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604090:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586949.604097:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+6:13184:x1875469127477504:12345-0@lo:104: Request processed in 86us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.604104:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586949.604125:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788586949.604131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:13184:x1875469127477632:12345-0@lo:104: 00010000:00010000:0.0:1788586949.604138:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604184:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586949.604189:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+5:13184:x1875469127477632:12345-0@lo:104: Request processed in 59us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.604195:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788586949.604204:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788586949.604211:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788586949.604217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:13184:x1875469127477760:12345-0@lo:104: 00010000:00010000:0.0:1788586949.604225:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604257:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586949.604262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+4:13184:x1875469127477760:12345-0@lo:104: Request processed in 46us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.604268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788586949.604279:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586949.604284:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13184:x1875469127477888:12345-0@lo:104: 00010000:00010000:0.0:1788586949.604291:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604323:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788586949.604328:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13184:x1875469127477888:12345-0@lo:104: Request processed in 45us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.604334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788586949.604350:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788586949.604356:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604362:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788586949.604366:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604375:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586949.604382:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586949.604388:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586949.604412:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604439:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586949.604457:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604466:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604466:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7600/0xfbc93bbea5fd990b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9912 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604484:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586949.604488:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604503:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604508:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1788586949.604510:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604513:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586949.604523:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586949.604527:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788586949.604532:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604539:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604544:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586949.604546:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586949.604560:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788586949.604570:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586949.604578:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.604585:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788586949.604734:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127478144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788586949.604777:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.604788:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586949.604789:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4e00/0xfbc93bbea5fd9935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd993c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604802:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586949.604807:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604813:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318b000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788586949.604817:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604825:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.604835:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127478400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788586949.604858:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.604874:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586949.604879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127478272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788586949.604897:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.604920:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478144 00000100:00100000:1.0:1788586949.604925:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478144 10000000:00010000:3.0:1788586949.604931:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586949.604938:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788586949.604955:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586949.604960:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 24 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604963:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586949.604980:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.604988:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b000/0xfbc93bbea5fd98b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd98be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.604993:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478400 00000100:00100000:1.0:1788586949.604998:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478400 00010000:00010000:3.0:1788586949.605009:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586949.605012:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586949.605014:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 25 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.605015:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586949.605031:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478272 00000100:00100000:1.0:1788586949.605034:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478272 00000100:00100000:3.0:1788586949.605037:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788586949.605049:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+26:3649:x1875469127478144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788586949.605058:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 26 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.605061:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586949.605071:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 26 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.605080:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788586949.605086:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 26 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.605091:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+26:3647:x1875469127478400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788586949.605103:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586949.605107:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788586949.605108:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 26 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586949.605119:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 26 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586949.605131:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586949.605145:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+26:3649:x1875469127478144:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586949.605153:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788586949.605170:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+25:3647:x1875469127478400:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586949.605176:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788586949.605183:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586949.605187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+25:3647:x1875469127478272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788586949.605197:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586949.605202:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 24 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.605223:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 24 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.605225:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127478400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788586949.605248:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586949.605290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127478272:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586949.605302:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788586949.605325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127478528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788586949.605350:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586949.605395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127478144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788586949.605435:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478528 00000100:00100000:3.0:1788586949.605439:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478528 00000100:00100000:1.0:1788586949.605450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127478272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788586949.605456:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 24 pid: 6516 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586949.605480:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586949.605485:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127478528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788586949.605492:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586949.605496:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 24 pid: 6516 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.605504:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 24 pid: 6516 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586949.605514:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586949.605547:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127478528:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586949.605554:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788586949.605734:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127478528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788586949.607543:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586949.607986:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7800/0xfbc93bbea5fd993c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9935 expref: 23 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.608004:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477504:0@lo:104: 00010000:00010000:2.0:1788586949.608016:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fd9912 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd990b expref: 22 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.608023:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477632:0@lo:104: 00010000:00010000:2.0:1788586949.608033:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd98e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd98e1 expref: 21 pid: 6514 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.608041:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477760:0@lo:104: 00010000:00010000:2.0:1788586949.608050:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd98be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd98b7 expref: 20 pid: 6516 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586949.608078:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477888:0@lo:104: 00010000:00010000:0.0:1788586949.609515:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.609531:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6800/0xfbc93bbea5fd98e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd98e8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.609554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586949.609556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586949.609559:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586949.610695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586949.610748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586949.610797:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625920 00000100:00100000:0.0:1788586949.610805:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625920 00010000:00010000:0.0:1788586949.610835:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 13 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586949.610872:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110625792 00000100:00100000:0.0:1788586949.610875:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110625792 00010000:00010000:0.0:1788586949.610886:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 14 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586949.610904:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:0.0:1788586949.610912:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+14:2408:x1875469110625920:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586949.610929:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586949.610935:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 14 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611147:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 14 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611177:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586949.611231:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+14:2408:x1875469110625920:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 319us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.611238:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:0.0:1788586949.611257:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:0.0:1788586949.611263:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110625792:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586949.611270:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586949.611274:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 13 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611289:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 13 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611300:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611309:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611323:0:8450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611329:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611336:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611342:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611347:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788586949.611352:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611360:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611367:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586949.611385:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586949.611404:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110625792:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 141us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.611410:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00010000:00010000:1.0:1788586949.611837:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fd995f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810725 expref: 12 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.611851:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127477376:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586949.612301:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fd9894 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106e6 expref: 11 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.612326:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875469127478016:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586949.612360:0:13184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586949.612370:0:13184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586949.612375:0:13184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586949.612381:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050400/0xfbc93bbea5fd9982 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586949.972697:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127478656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586949.972781:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.972873:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127478912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586949.972903:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.972922:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586949.972929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127478784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788586949.972948:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478656 00000100:00100000:1.0:1788586949.972955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586949.972958:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478656 00000100:00100000:1.0:1788586949.972996:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478784 00000100:00100000:0.0:1788586949.973000:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127478912 00000100:00100000:1.0:1788586949.973002:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478784 00000100:00100000:0.0:1788586949.973006:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127478912 00000100:00100000:0.0:1788586949.973034:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788586949.973044:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127478656:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586949.973046:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788586949.973059:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127478784:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1788586949.973077:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1788586949.973087:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788586949.973138:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127478784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586949.973153:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788586949.973173:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127478656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.973181:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788586949.973200:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788586949.973205:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127478784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788586949.973210:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127478912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586949.973224:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788586949.973242:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83607b80 x1875469127478656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586949.973257:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127478656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788586949.973262:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127478912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586949.973270:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788586949.973289:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83605880 x1875469127478912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586949.973301:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127478912:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788586949.975085:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000020:00000080:0.0:1788586949.975094:0:9513:0:(genops.c:885:class_export_put()) final put ffff8f5a81bcf800/398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000020:00000080:3.0:1788586949.975182:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bcf800/398d2026-4c2a-4f38-a64f-9cac397cc1c6 for lustre-OST0001 00000020:00000080:3.0:1788586949.975232:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbc98a000 for lustre-OST0001 00000001:00100000:0.0:1788586949.981968:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000020:00000080:0.0:1788586949.981978:0:8429:0:(genops.c:885:class_export_put()) final put ffff8f5bbfb22000/398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000020:00000080:3.0:1788586949.982153:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfb22000/398d2026-4c2a-4f38-a64f-9cac397cc1c6 for lustre-OST0000 00000020:00000080:3.0:1788586949.982353:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfb22800 for lustre-OST0000 00010000:00010000:3.0:1788586950.100626:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788586950.804810:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586950.804818:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bbcb3b800 from 7 10000000:01000000:2.0:1788586950.804823:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586950.804944:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.804958:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.804971:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586950.805076:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.805141:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.805287:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.815179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479040 00000100:00100000:1.0:1788586950.815194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479040 00000100:00100000:1.0:1788586950.815262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788586950.815271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127479040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586950.815288:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586950.815306:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9989 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.815332:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.815343:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.815352:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030200, rc 0) 00000100:00100000:1.0:1788586950.816251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127479040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 977us (11105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.816269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788586950.816569:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586950.816589:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.816599:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586950.816674:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.816710:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.816757:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99900 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.816806:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479168 00000100:00100000:1.0:1788586950.816811:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479168 00000100:00100000:1.0:1788586950.816848:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788586950.816952:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127479168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586950.817130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127479168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.817136:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788586950.817198:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.817227:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.817266:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.817290:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99900 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.817337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479296 00000100:00100000:1.0:1788586950.817341:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479296 00000100:00100000:1.0:1788586950.817369:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788586950.817376:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127479296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586950.817476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127479296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.817483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788586950.817565:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788586950.818824:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788586950.819083:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788586950.819104:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586950.819115:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.819126:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586950.819136:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586950.819138:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bae583000 from 7 10000000:01000000:2.0:1788586950.819141:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586950.819172:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.819189:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.819199:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586950.819221:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.819267:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.819342:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.819580:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479424 00000100:00100000:1.0:1788586950.819586:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479424 00000100:00100000:1.0:1788586950.819664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788586950.819674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127479424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586950.819686:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586950.819699:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9997 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.819719:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.819730:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.819745:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030c00, rc 0) 00000100:00100000:1.0:1788586950.819802:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127479424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.819808:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788586950.819881:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586950.819895:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.819903:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586950.819954:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.819977:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.820189:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586950.820227:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479552 00000100:00100000:3.0:1788586950.820232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479552 00000100:00100000:3.0:1788586950.820251:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788586950.820257:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127479552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.820357:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127479552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586950.820363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788586950.820482:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.820507:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.820545:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.820560:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586950.820602:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479680 00000100:00100000:3.0:1788586950.820606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479680 00000100:00100000:3.0:1788586950.820633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788586950.820646:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127479680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.820714:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127479680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586950.820721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788586950.820833:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788586950.821935:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788586950.822279:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788586950.822300:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788586950.822310:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.822321:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586950.822332:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788586950.822335:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5baaa5e000 from 7 10000000:01000000:3.0:1788586950.822337:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788586950.822367:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.822375:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.822384:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586950.824652:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.824714:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.824796:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a836fca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.824941:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479808 00000100:00100000:1.0:1788586950.824949:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479808 00000100:00100000:1.0:1788586950.825079:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788586950.825088:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127479808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586950.825104:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586950.825119:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd99a5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.825142:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.825152:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.825161:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80031000, rc 0) 00000100:00100000:1.0:1788586950.825206:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127479808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.825212:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788586950.825280:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586950.825295:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.825312:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586950.825380:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.825438:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.825625:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a836fca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586950.825660:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127479936 00000100:00100000:2.0:1788586950.825665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127479936 00000100:00100000:2.0:1788586950.825687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788586950.825694:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127479936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.825814:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127479936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586950.825821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788586950.825899:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127479936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.825931:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.825970:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.825985:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a836fca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.826607:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480064 00000100:00100000:0.0:1788586950.826613:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480064 00000100:00100000:0.0:1788586950.826648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788586950.826655:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127480064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586950.826842:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127480064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.826849:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788586950.829679:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788586950.830769:0:13239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788586950.832160:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788586950.832199:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586950.832211:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.832222:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586950.832233:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586950.832236:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5b86e73000 from 7 10000000:01000000:2.0:1788586950.832239:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586950.832273:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.832282:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.832292:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586950.832315:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.832378:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.832443:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480192 00000100:00100000:0.0:1788586950.832452:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480192 00000100:00100000:2.0:1788586950.832457:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.832581:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788586950.832592:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127480192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586950.832604:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586950.832618:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd99b3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.832645:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.832703:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.832713:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788586950.832768:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127480192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.832774:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788586950.833354:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586950.833371:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.833381:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586950.833475:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.833507:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.833532:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586950.833582:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480320 00000100:00100000:3.0:1788586950.833588:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480320 00000100:00100000:3.0:1788586950.833620:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788586950.833628:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127480320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586950.833742:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127480320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586950.833761:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788586950.833949:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.833976:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586950.834638:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.834666:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.834759:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480448 00000100:00100000:0.0:1788586950.834764:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480448 00000100:00100000:0.0:1788586950.834810:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788586950.834818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127480448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586950.834923:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127480448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.834937:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788586950.835009:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127480448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788586950.836264:0:13240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788586950.836686:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788586950.836710:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788586950.836721:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.836744:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586951.125948:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586951.338976:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586951.339014:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626048 00000100:00100000:3.0:1788586951.339023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626048 00000100:00100000:3.0:1788586951.339071:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 321 00000100:00100000:3.0:1788586951.339082:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+11:6177:x1875469110626048:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586951.339098:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586951.339117:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810756 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586951.339143:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586951.339155:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586951.339164:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecc400, rc 0) 00000100:00100000:3.0:1788586951.339213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110626048:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586951.339220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 321 00000100:00100000:3.0:1788586951.343645:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586951.343685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626176 00000100:00100000:3.0:1788586951.343697:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626176 00000100:00100000:3.0:1788586951.343742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 322 00000100:00100000:3.0:1788586951.343763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110626176:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586951.343910:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110626176:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 149us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586951.343918:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 322 00000100:00100000:3.0:1788586951.345572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586951.345777:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626304 00000100:00100000:2.0:1788586951.345786:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626304 00000100:00100000:2.0:1788586951.345831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 323 00000100:00100000:2.0:1788586951.345841:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110626304:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586951.345959:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110626304:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 120us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586951.345968:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 323 00000100:00100000:3.0:1788586951.358862:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586951.358900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626432 00000100:00100000:3.0:1788586951.358910:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626432 00000100:00100000:3.0:1788586951.358966:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 324 00000100:00100000:3.0:1788586951.358976:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110626432:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586951.358992:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586951.359010:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c81075d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586951.359038:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586951.359049:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586951.359059:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecca00, rc 0) 00000100:00100000:3.0:1788586951.359109:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110626432:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 134us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586951.359116:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 324 00000100:00100000:2.0:1788586951.371622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586951.375619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626560 00000100:00100000:0.0:1788586951.375634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626560 00000100:00100000:0.0:1788586951.375731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 325 00000100:00100000:0.0:1788586951.375752:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110626560:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586951.375914:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110626560:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 173us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586951.375922:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 325 00000100:00100000:0.0:1788586951.391636:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586951.391734:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626688 00000100:00100000:1.0:1788586951.391753:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626688 00000100:00100000:1.0:1788586951.391809:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 326 00000100:00100000:1.0:1788586951.391820:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110626688:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586951.391953:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110626688:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 134us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586951.391961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 326 00000100:00100000:2.0:1788586951.508765:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788586951.508785:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127480576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586951.508859:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586951.508919:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480576 00000100:00100000:2.0:1788586951.508926:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480576 00000100:00100000:2.0:1788586951.508964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788586951.508972:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127480576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586951.509003:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586951.509044:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127480576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586951.509051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788586951.509094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127480576:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788586952.151378:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586953.175538:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586953.194182:0:13382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788586954.068709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127480704:0@lo:400:kworker.0 00000100:00100000:2.0:1788586954.068795:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.068932:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480704 00000100:00100000:0.0:1788586954.068940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480704 00000100:00100000:0.0:1788586954.068986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788586954.068995:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586954.070440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127481216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586954.070493:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.070736:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127480704:12345-0@lo:400:kworker.0 Request processed in 1730us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.070747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788586954.070792:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127480832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586954.070815:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.070848:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586954.070855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127480960:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.070889:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.070921:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481216 00000100:00100000:0.0:1788586954.070928:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481216 00000100:00100000:0.0:1788586954.070960:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480832 00000100:00100000:0.0:1788586954.070963:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480832 00000100:00100000:0.0:1788586954.070989:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788586954.071306:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127481216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788586954.071334:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586954.071379:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127481216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.071385:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788586954.071398:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788586954.071403:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127480832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788586954.071411:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586954.071453:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127480832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.071459:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788586954.071472:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788586954.071496:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a834a0700 x1875469127480832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586954.071514:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127480832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586954.071570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127480960 00000100:00100000:0.0:1788586954.071574:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127480960 00000100:00100000:0.0:1788586954.071601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788586954.071607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127480960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.071651:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127480960:12345-0@lo:400:kworker.0 Request processed in 45us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.071657:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788586954.071698:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127480960:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.071734:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127481088:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.071763:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.071817:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481088 00000100:00100000:0.0:1788586954.071821:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481088 00000100:00100000:2.0:1788586954.071826:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127480704:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.071857:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788586954.071865:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127481088:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788586954.071919:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83605c00 x1875469127481216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586954.071934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127481216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586954.072210:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127481344:0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.072239:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586954.072270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481344 00000100:00100000:1.0:1788586954.072274:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481344 00000100:00100000:1.0:1788586954.072300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788586954.072306:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127481344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.072340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127481344:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586954.072347:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788586954.072348:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127481088:12345-0@lo:400:kworker.0 Request processed in 485us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.072354:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788586954.072373:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127481344:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.072373:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127481088:0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.072401:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586954.072407:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127481472:0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.072447:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.072447:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127481600:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.072468:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586954.072469:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481472 00000100:00100000:1.0:1788586954.072472:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481472 00000100:00100000:0.0:1788586954.072489:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481600 00000100:00100000:0.0:1788586954.072493:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481600 00000100:00100000:0.0:1788586954.072517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788586954.072523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127481600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.072743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127481600:12345-0@lo:400:kworker.0 Request processed in 95us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.072752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1788586954.072769:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586954.072787:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127481600:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.072812:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788586954.072817:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127481728:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.072850:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586954.073202:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586954.073211:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127481472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.073256:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788586954.073265:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127481856:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.073293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586954.073310:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481856 00000100:00100000:2.0:1788586954.073315:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481856 00000100:00100000:2.0:1788586954.073353:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788586954.073360:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127481856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586954.073394:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127481856:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586954.073412:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788586954.073447:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586954.073618:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127481472:12345-0@lo:400:kworker.0 Request processed in 408us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586954.073626:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586954.073651:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481728 00000100:00100000:1.0:1788586954.073655:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481728 00000100:00100000:1.0:1788586954.073690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788586954.073697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127481728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.073745:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127481728:12345-0@lo:400:kworker.0 Request processed in 49us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586954.073751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788586954.073780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127481472:0@lo:400:kworker.0 00000100:00080000:2.0:1788586954.073794:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586954.073794:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586954.073799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127481984:0@lo:400:kworker.0 00010000:00080000:2.0:1788586954.073822:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a834a0a80 x1875469127481728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586954.073823:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586954.073844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127481728:0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.073849:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127481984 00000100:00100000:1.0:1788586954.073852:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127481984 00000100:00100000:1.0:1788586954.073880:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788586954.073886:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127481984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.073932:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127481984:12345-0@lo:400:kworker.0 Request processed in 46us (107us total) trans 0 rc 0/0 00010000:00080000:2.0:1788586954.074004:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbfad80 x1875469127481984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586954.074016:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788586954.074020:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127481984:0@lo:400:kworker.0 00000100:00080000:1.0:1788586954.074031:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586954.074051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a834a1c00 x1875469127481856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586954.074059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127481856:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.074226:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127482240:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.074261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586954.074289:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586954.074295:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127482112:0@lo:400:kworker.0 00000100:00100000:0.0:1788586954.074315:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586954.074513:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482240 00000100:00100000:2.0:1788586954.074518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482240 00000100:00100000:1.0:1788586954.074572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482112 00000100:00100000:1.0:1788586954.074577:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482112 00000100:00100000:2.0:1788586954.074772:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788586954.074777:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788586954.074779:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.074782:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127482112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586954.074817:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127482112:12345-0@lo:400:kworker.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586954.074824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788586954.075597:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586954.075602:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586954.075859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788586954.076121:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127482240:12345-0@lo:400:kworker.0 Request processed in 1340us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586954.076130:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:1.0:1788586954.076191:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbdbfa680 x1875469127482240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586954.076202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127482240:0@lo:400:kworker.0 00010000:00010000:0.0:1788586954.196783:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586954.352579:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586954.352618:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586954.352705:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586954.352744:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586954.352946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626816 00000100:00100000:0.0:1788586954.352956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626816 00000100:00100000:0.0:1788586954.352996:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 328 00000100:00100000:0.0:1788586954.353006:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110626816:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586954.353071:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110626816:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 66us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.353079:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 328 00000100:00100000:1.0:1788586954.358247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110626944 00000100:00100000:1.0:1788586954.358261:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110626944 00000100:00100000:2.0:1788586954.358319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586954.358387:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627200 00000100:00100000:1.0:1788586954.358392:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627200 00000100:00100000:0.0:1788586954.358400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627072 00000100:00100000:0.0:1788586954.358404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627072 00000100:00100000:0.0:1788586954.358464:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627328 00000100:00100000:0.0:1788586954.358467:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627328 00000100:00100000:1.0:1788586954.359970:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 167 00000100:00100000:1.0:1788586954.359990:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110627072:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586954.360076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110627072:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 95us (7331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586954.360083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 167 00000100:00100000:1.0:1788586954.360103:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 168 00000100:00100000:1.0:1788586954.360109:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110627200:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586954.360131:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110627200:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 23us (7513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586954.360138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 168 00000100:00080000:2.0:1788586954.360968:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586954.360974:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586954.362256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 169 00000100:00100000:0.0:1788586954.362289:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110627328:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586954.362479:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110627328:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 212us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.362487:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 169 00000100:00100000:0.0:1788586954.362548:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 170 00000100:00100000:0.0:1788586954.362555:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110626944:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586954.362581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110626944:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 27us (10012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586954.362603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 170 00000100:00080000:2.0:1788586954.362748:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586955.092705:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127482368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586955.092795:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127482496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586955.092805:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586955.092849:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788586955.092866:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127482624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586955.092875:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482368 00000100:00100000:0.0:1788586955.092883:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482368 00000100:00100000:0.0:1788586955.092925:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788586955.092934:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127482368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788586955.092959:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586955.096175:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586955.096294:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482496 00000100:00100000:3.0:1788586955.096317:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482496 00000100:00100000:3.0:1788586955.096370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788586955.096380:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127482496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788586955.096429:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586955.096484:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127482496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586955.096491:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788586955.096538:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbdbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127482496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586955.102090:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586955.102159:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788586955.102171:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788586955.102263:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127482368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9326us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586955.102276:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788586955.102304:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482624 00000100:00100000:0.0:1788586955.102312:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482624 00000100:00100000:0.0:1788586955.102345:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788586955.102353:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127482624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586955.102375:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586955.102444:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127482624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586955.102450:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788586955.102591:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83c55880 x1875469127482368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586955.102613:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127482368:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788586955.105392:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83604000 x1875469127482624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586955.105462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127482624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788586955.220752:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586956.255900:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586956.629824:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127482752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586956.629894:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586956.630011:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482752 00000100:00100000:3.0:1788586956.630019:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482752 00000100:00100000:3.0:1788586956.631052:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788586956.631075:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127482752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586956.631113:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586956.631189:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127482752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586956.631196:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788586956.631266:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127482752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586957.077272:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127483264:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077345:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586957.077403:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127483776:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077459:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586957.077484:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127484288:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077505:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586957.077535:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788586957.077542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127483136:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077581:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586957.077599:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127483648:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077616:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586957.077642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127484160:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077659:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586957.077689:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483776 00000100:00100000:3.0:1788586957.077696:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483776 00000100:00100000:3.0:1788586957.077828:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484288 00000100:00100000:3.0:1788586957.077831:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484288 00000100:00100000:3.0:1788586957.077855:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788586957.077864:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127483776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.077985:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127483776:12345-0@lo:400:kworker.0 Request processed in 122us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586957.077992:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788586957.078011:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788586957.078018:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127484288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.078046:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127484288:12345-0@lo:400:kworker.0 Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586957.078052:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788586957.078075:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483136 00000100:00100000:3.0:1788586957.078079:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483136 00000100:00100000:3.0:1788586957.078100:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788586957.078106:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127483136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.078138:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127483136:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586957.078144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788586957.078172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483264 00000100:00100000:3.0:1788586957.078175:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483264 00000100:00100000:3.0:1788586957.078197:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483648 00000100:00100000:3.0:1788586957.078200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483648 00000100:00100000:3.0:1788586957.078211:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484160 00000100:00100000:3.0:1788586957.078213:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484160 00000100:00100000:3.0:1788586957.078225:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788586957.078231:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127483264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.078261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127483264:12345-0@lo:400:kworker.0 Request processed in 31us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586957.078267:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788586957.078277:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788586957.078283:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127483648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.078309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127483648:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586957.078325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788586957.078336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788586957.078341:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127484160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.078368:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127484160:12345-0@lo:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586957.078373:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1788586957.078386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788586957.078391:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586957.078393:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586957.078462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127483136:0@lo:400:kworker.0 00010000:00080000:3.0:1788586957.078476:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83604700 x1875469127483648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586957.078500:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127483648:0@lo:400:kworker.0 00010000:00080000:3.0:1788586957.078515:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83605f80 x1875469127484160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586957.078524:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127484160:0@lo:400:kworker.0 00000100:00100000:3.0:1788586957.078535:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127483264:0@lo:400:kworker.0 00010000:00080000:3.0:1788586957.078545:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83604e00 x1875469127483776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586957.078553:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127483776:0@lo:400:kworker.0 00010000:00080000:3.0:1788586957.078563:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83607480 x1875469127484288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586957.078570:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127484288:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079016:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127483008:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079089:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127483520:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079135:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127484032:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079155:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788586957.079182:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127482880:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079224:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127483392:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079263:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127483904:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127484416:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586957.079359:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483008 00000100:00100000:0.0:1788586957.079363:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483008 00000100:00100000:0.0:1788586957.079386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483520 00000100:00100000:0.0:1788586957.079389:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483520 00000100:00100000:0.0:1788586957.079407:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484032 00000100:00100000:0.0:1788586957.079409:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484032 00000100:00100000:0.0:1788586957.079447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788586957.079453:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127483008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079494:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127483008:12345-0@lo:400:kworker.0 Request processed in 41us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.079500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788586957.079512:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788586957.079517:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127483520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079543:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127483520:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.079548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788586957.079558:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788586957.079564:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127484032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079599:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127484032:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.079605:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788586957.079637:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483392 00000100:00100000:0.0:1788586957.079640:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483392 00000100:00100000:0.0:1788586957.079665:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788586957.079671:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127483392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.079702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127483392:12345-0@lo:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.079722:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788586957.079870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127482880 00000100:00100000:0.0:1788586957.079874:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127482880 00000100:00100000:0.0:1788586957.080188:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788586957.080198:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127482880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127482880:12345-0@lo:400:kworker.0 Request processed in 40us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.080240:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788586957.080285:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127483904 00000100:00100000:0.0:1788586957.080289:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127483904 00000100:00100000:0.0:1788586957.080317:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484416 00000100:00100000:0.0:1788586957.080320:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484416 00000100:00100000:0.0:1788586957.080338:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788586957.080344:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127483904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080374:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127483904:12345-0@lo:400:kworker.0 Request processed in 30us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.080381:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788586957.080391:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788586957.080405:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127484416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080468:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127484416:12345-0@lo:400:kworker.0 Request processed in 63us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586957.080474:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788586957.080493:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586957.080496:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586957.080498:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586957.080530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127482880:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080542:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127483392:0@lo:400:kworker.0 00010000:00080000:0.0:1788586957.080553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83607800 x1875469127483904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586957.080563:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127483904:0@lo:400:kworker.0 00010000:00080000:0.0:1788586957.080574:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83604380 x1875469127484416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586957.080581:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127484416:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127483008:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080600:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127483520:0@lo:400:kworker.0 00000100:00100000:0.0:1788586957.080608:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127484032:0@lo:400:kworker.0 00010000:00010000:0.0:1788586957.268660:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788586958.001081:0:13532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:42:36 (1788586956) === 00010000:00010000:1.0:1788586958.293140:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586958.306118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586958.306167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586958.306247:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627584 00000100:00100000:1.0:1788586958.306256:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627584 00000100:00100000:0.0:1788586958.306313:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627456 00000100:00100000:0.0:1788586958.306318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627456 00000100:00100000:0.0:1788586958.306377:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:0.0:1788586958.306388:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110627456:12345-192.168.203.1@tcp:41:mkdir.0 00000100:00100000:1.0:1788586958.306457:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:1.0:1788586958.306467:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:207b4310-f56a-4e63-b878-60fda37c3e93+7:10485:x1875469110627584:12345-192.168.203.1@tcp:700:mkdir.0 00000100:00080000:3.0:1788586958.306528:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586958.306540:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:207b4310-f56a-4e63-b878-60fda37c3e93+7:10485:x1875469110627584:12345-192.168.203.1@tcp:700:mkdir.0 Request processed in 73us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586958.306548:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 2 00000004:00000024:0.0:1788586958.306796:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788586958.306854:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110627456:12345-192.168.203.1@tcp:41:mkdir.0 Request processed in 468us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.306861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:2.0:1788586958.314643:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.315552:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627840 00000100:00100000:0.0:1788586958.315562:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627840 00000100:00100000:0.0:1788586958.315622:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:0.0:1788586958.315631:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:10485:x1875469110627840:12345-192.168.203.1@tcp:36:mkdir.0 00010000:00010000:0.0:1788586958.315688:0:10048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586958.315730:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fd9871 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106d1 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.315750:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83579000) 00010000:00010000:0.0:1788586958.315760:0:10048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586958.315893:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.315907:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.315917:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.317315:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.317334:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.317362:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.317957:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.317968:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.317976:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788586958.317993:0:10048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b52f3541 reply state 00000000aca7b78e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318003:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318010:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90e00) 00010000:00010000:0.0:1788586958.318013:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788586958.318017:0:10048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788586958.318022:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788586958.318030:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318036:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318042:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318048:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.318059:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318067:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318076:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5baaa90900) 00010000:00010000:0.0:1788586958.318079:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586958.318082:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318088:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788586958.318103:0:10048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b52f3541 reply state 00000000aca7b78e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318112:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.318118:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f5baaa90b00) 00010000:00010000:0.0:1788586958.318120:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788586958.318122:0:10048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788586958.318213:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:10485:x1875469110627840:12345-192.168.203.1@tcp:36:mkdir.0 Request processed in 2579us (3576us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788586958.318221:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:1.0:1788586958.330161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.331353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110627968 00000100:00100000:0.0:1788586958.331365:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110627968 00000100:00100000:0.0:1788586958.331444:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:0.0:1788586958.331456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:10488:x1875469110627968:12345-192.168.203.1@tcp:101:chmod.0 00010000:00010000:0.0:1788586958.331480:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586958.331522:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810764 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.331587:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd99eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.331602:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd99eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.331614:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd99eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586958.331658:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788586958.331662:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586958.331716:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd99eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.331740:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd99e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810764 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.331757:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd99eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810764 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.331766:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5baaa90900) 00010000:00010000:0.0:1788586958.331769:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788586958.331773:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5e00, rc 0) 00000100:00100000:0.0:1788586958.332237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:10488:x1875469110627968:12345-192.168.203.1@tcp:101:chmod.0 Request processed in 782us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.332246:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:1.0:1788586958.339828:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.340149:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110628224 00000100:00100000:3.0:1788586958.340160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110628224 00000100:00100000:3.0:1788586958.340268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:3.0:1788586958.340279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:10488:x1875469110628224:12345-192.168.203.1@tcp:36:chmod.0 00010000:00010000:3.0:1788586958.340335:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586958.340363:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd99eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810764 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.340383:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5baaa90900) 00010000:00010000:3.0:1788586958.340408:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586958.340590:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.340603:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.340934:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788586958.341137:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071a8e83f reply state 0000000035c606ec transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.341150:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.341157:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788586958.341160:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788586958.341162:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788586958.341170:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788586958.341256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:10488:x1875469110628224:12345-192.168.203.1@tcp:36:chmod.0 Request processed in 979us (1436us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788586958.341264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:3.0:1788586958.360907:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586958.361401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110628352 00000100:00100000:2.0:1788586958.361413:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110628352 00000100:00100000:2.0:1788586958.361508:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:2.0:1788586958.361519:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:10489:x1875469110628352:12345-192.168.203.1@tcp:101:chown.0 00010000:00010000:2.0:1788586958.361544:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586958.361566:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd99f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81076b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.361624:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9a00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.361637:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9a00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.361648:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9a00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586958.361724:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788586958.361728:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586958.361763:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9a00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.361789:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd99f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81076b expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.361807:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9a00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81076b expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.361816:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788586958.361819:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788586958.361822:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050200, rc 0) 00000100:00100000:2.0:1788586958.361880:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+10:10489:x1875469110628352:12345-192.168.203.1@tcp:101:chown.0 Request processed in 363us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586958.361887:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:2.0:1788586958.369539:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.369609:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110628480 00000100:00100000:0.0:1788586958.369629:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110628480 00000100:00100000:0.0:1788586958.369685:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:0.0:1788586958.369694:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+10:10489:x1875469110628480:12345-192.168.203.1@tcp:101:chown.0 00010000:00010000:0.0:1788586958.369722:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586958.369741:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810772 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369802:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369816:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369826:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369836:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369842:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369848:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369915:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369923:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.369930:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586958.369976:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788586958.369980:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586958.370001:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370013:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370020:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370027:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370034:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.370038:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370046:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370058:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788586958.370061:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586958.370065:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370072:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370084:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370099:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370105:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370110:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.370113:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370133:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370140:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f5baaa90b00) 00010000:00010000:0.0:1788586958.370142:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586958.370145:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370151:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370175:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810772 expref: 12 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370187:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810772 expref: 11 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.370195:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90e00) 00010000:00010000:0.0:1788586958.370197:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788586958.370205:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5e00, rc 0) 00000100:00100000:0.0:1788586958.370263:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+11:10489:x1875469110628480:12345-192.168.203.1@tcp:101:chown.0 Request processed in 569us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.370270:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:1.0:1788586958.373070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.373150:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110628608 00000100:00100000:3.0:1788586958.373160:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110628608 00000100:00100000:3.0:1788586958.373224:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:3.0:1788586958.373234:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:207b4310-f56a-4e63-b878-60fda37c3e93+11:10489:x1875469110628608:12345-192.168.203.1@tcp:900:chown.0 00000100:00100000:3.0:1788586958.373313:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:207b4310-f56a-4e63-b878-60fda37c3e93+11:10489:x1875469110628608:12345-192.168.203.1@tcp:900:chown.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586958.373341:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:2.0:1788586958.378828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.378929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110628864 00000100:00100000:0.0:1788586958.378940:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110628864 00000100:00100000:0.0:1788586958.378998:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:0.0:1788586958.379008:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+11:10489:x1875469110628864:12345-192.168.203.1@tcp:36:chown.0 00010000:00010000:0.0:1788586958.379056:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586958.379082:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810772 expref: 11 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.379102:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90e00) 00010000:00010000:0.0:1788586958.379108:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586958.379136:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.379150:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.379161:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788586958.381554:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1788586958.381662:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003371e776 reply state 00000000bf558010 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381681:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.381685:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381707:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.381714:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90e00) 00010000:00010000:1.0:1788586958.381717:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381724:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.381729:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788586958.381731:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586958.381735:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788586958.381743:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586958.381749:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788586958.381757:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f5baaa90b00) 00010000:00010000:1.0:1788586958.381762:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586958.381774:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381781:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd99d6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381813:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381821:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381827:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381833:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586958.381836:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788586958.381842:0:6520:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1788586958.381844:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.381855:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90e00) 00010000:00010000:1.0:1788586958.381858:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586958.381861:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586958.381869:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:10489:x1875469110628864:12345-192.168.203.1@tcp:36:chown.0 Request processed in 2857us (3043us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1788586958.381870:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd99dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586958.381884:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 28 00010000:00010000:2.0:1788586958.381975:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.381984:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.381990:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.381996:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586958.382004:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.382011:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.382020:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90e00) 00010000:00010000:2.0:1788586958.382022:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788586958.382025:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.382031:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382899:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382906:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382926:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382931:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecce00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586958.382935:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382941:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382950:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:1.0:1788586958.382953:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788586958.382956:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.382962:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd99f2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586958.397724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.401498:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110628992 00000100:00100000:0.0:1788586958.401991:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110628992 00000100:00100000:0.0:1788586958.402530:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:0.0:1788586958.402545:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:10490:x1875469110628992:12345-192.168.203.1@tcp:101:touch.500 00010000:00010000:0.0:1788586958.402584:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586958.402610:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810779 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788586958.407376:0:10048:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4677us 00010000:00010000:0.0:1788586958.422098:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422141:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422156:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422177:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422184:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422192:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422372:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422382:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422389:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586958.422452:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788586958.422457:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586958.422503:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422517:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422523:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422531:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422537:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.422542:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422550:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422565:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788586958.422575:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586958.422582:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422588:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422600:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422606:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422611:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422616:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.422619:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422624:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422631:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f5baaa90500) 00010000:00010000:0.0:1788586958.422634:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586958.422636:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422641:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422688:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810779 expref: 8 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422734:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810779 expref: 7 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.422742:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:0.0:1788586958.422744:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788586958.422747:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788586958.422847:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:10490:x1875469110628992:12345-192.168.203.1@tcp:101:touch.500 Request processed in 20305us (25439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.422857:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:3.0:1788586958.433466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586958.433616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110629248 00000100:00100000:2.0:1788586958.433631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110629248 00000100:00100000:2.0:1788586958.433719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:2.0:1788586958.433731:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:10490:x1875469110629248:12345-192.168.203.1@tcp:101:touch.500 00010000:00010000:2.0:1788586958.433757:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586958.433784:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9a46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810780 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.433950:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.433969:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.433982:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.434019:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.434028:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.434034:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788586958.434806:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788586958.435313:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fd9a5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435328:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fd9a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435337:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fd9a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435491:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435499:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435507:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435514:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586958.435518:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435539:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435555:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:2.0:1788586958.435558:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586958.435565:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435572:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9a4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788586958.435590:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ee0c1d4 reply state 000000008400d2ee transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435602:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435609:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f5ba19c9200) 00010000:00010000:2.0:1788586958.435612:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788586958.435615:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788586958.435659:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9a46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810780 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435675:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fd9a5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810780 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.435684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5ba19c9100) 00010000:00010000:2.0:1788586958.435686:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586958.435688:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051800, rc 0) 00000100:00100000:2.0:1788586958.435792:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:10490:x1875469110629248:12345-192.168.203.1@tcp:101:touch.500 Request processed in 2062us (2381us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788586958.435808:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:2.0:1788586958.441607:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.441723:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110629504 00000100:00100000:3.0:1788586958.441738:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110629504 00000100:00100000:3.0:1788586958.441859:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:3.0:1788586958.441872:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+10:10490:x1875469110629504:12345-192.168.203.1@tcp:36:touch.500 00010000:00010000:3.0:1788586958.441977:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586958.442014:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fd9a5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810780 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.442039:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5ba19c9100) 00010000:00010000:3.0:1788586958.442068:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586958.442161:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.442178:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.442191:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788586958.442335:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000109cb528 reply state 000000002bf2b7d6 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.442349:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.442388:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:3.0:1788586958.442391:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788586958.442394:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788586958.442546:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+11:10490:x1875469110629504:12345-192.168.203.1@tcp:36:touch.500 Request processed in 676us (953us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788586958.442555:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:1.0:1788586958.448073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.448542:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110629632 00000100:00100000:0.0:1788586958.448556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110629632 00000100:00100000:0.0:1788586958.448795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:0.0:1788586958.448809:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+11:10490:x1875469110629632:12345-192.168.203.1@tcp:101:touch.500 00010000:00010000:0.0:1788586958.448843:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586958.448869:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810787 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.448959:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810787 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.448977:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810787 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.449001:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:0.0:1788586958.449005:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788586958.449028:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5e00, rc 0) 00000100:00100000:0.0:1788586958.449140:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+12:10490:x1875469110629632:12345-192.168.203.1@tcp:101:touch.500 Request processed in 333us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.449148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:1.0:1788586958.456025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.456327:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110629760 00000100:00100000:0.0:1788586958.456340:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110629760 00000100:00100000:0.0:1788586958.456412:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:0.0:1788586958.456459:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2405:x1875469110629760:12345-192.168.203.1@tcp:8:touch.500 00010000:00080000:0.0:1788586958.456505:0:10047:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:0.0:1788586958.457009:0:10047:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd9a77 00002000:00100000:0.0:1788586958.457027:0:10047:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 207b4310-f56a-4e63-b878-60fda37c3e93/ffff8f5bbfb26800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788586958.457049:0:10047:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788586958.458407:0:10047:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788586958.458492:0:10047:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb23800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586958.458588:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110629760:12345-192.168.203.1@tcp:8:touch.500 Request processed in 2127us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.458600:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:3.0:1788586958.461822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.462256:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110629888 00000100:00100000:0.0:1788586958.462272:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110629888 00000100:00100000:0.0:1788586958.462384:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:0.0:1788586958.462396:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:0:x1875469110629888:12345-192.168.203.1@tcp:2:touch.500 00000100:00080000:3.0:1788586958.463657:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788586958.466067:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788586958.466098:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000100:00100000:3.0:1788586958.466457:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:0:x1875469110629888:12345-192.168.203.1@tcp:2:touch.500 Request processed in 4056us (4653us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788586958.466471:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:1.0:1788586958.470082:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586958.470186:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110630144 00000100:00100000:2.0:1788586958.470201:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110630144 00000100:00100000:2.0:1788586958.470604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:2.0:1788586958.470625:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+12:10490:x1875469110630144:12345-192.168.203.1@tcp:35:touch.500 00000100:00100000:2.0:1788586958.471002:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+13:10490:x1875469110630144:12345-192.168.203.1@tcp:35:touch.500 Request processed in 387us (931us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788586958.471013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:1.0:1788586958.488558:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.489117:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110630272 00000100:00100000:0.0:1788586958.489130:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110630272 00000100:00100000:0.0:1788586958.489261:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:0.0:1788586958.489275:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+13:10491:x1875469110630272:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1788586958.489309:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586958.489354:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81078e expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.489481:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.489511:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.489527:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586958.489586:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788586958.489591:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586958.489658:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.489693:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81078e expref: 15 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.489728:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81078e expref: 14 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.489738:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:0.0:1788586958.489741:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788586958.489745:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788586958.489839:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:10491:x1875469110630272:12345-192.168.203.1@tcp:101:rm.0 Request processed in 567us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.489848:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:2.0:1788586958.494979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.495120:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110630528 00000100:00100000:0.0:1788586958.495148:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110630528 00000100:00100000:0.0:1788586958.495466:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:0.0:1788586958.495481:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+14:10491:x1875469110630528:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1788586958.495740:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586958.495769:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9a8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810795 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586958.496083:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788586958.496269:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9a8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810795 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.496287:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788586958.496291:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788586958.496297:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9a8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810795 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.496314:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5800, rc 0) 00000100:00100000:0.0:1788586958.496394:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+15:10491:x1875469110630528:12345-192.168.203.1@tcp:101:rm.0 Request processed in 917us (1428us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788586958.496402:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:1.0:1788586958.502338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586958.502438:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110630656 00000100:00100000:0.0:1788586958.502451:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110630656 00000100:00100000:0.0:1788586958.502527:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:0.0:1788586958.502539:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+15:10491:x1875469110630656:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:0.0:1788586958.512437:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+15:10491:x1875469110630656:12345-192.168.203.1@tcp:37:rm.0 Request processed in 9866us (10081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586958.512458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:2.0:1788586958.517165:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586958.517359:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110630912 00000100:00100000:1.0:1788586958.517374:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110630912 00000100:00100000:1.0:1788586958.517601:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:1.0:1788586958.517688:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+15:10491:x1875469110630912:12345-192.168.203.1@tcp:35:rm.0 00000100:00100000:1.0:1788586958.518137:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+16:10491:x1875469110630912:12345-192.168.203.1@tcp:35:rm.0 Request processed in 524us (986us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788586958.518173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:1.0:1788586958.522165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.522276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110631168 00000100:00100000:3.0:1788586958.522291:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110631168 00000100:00100000:3.0:1788586958.522405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:3.0:1788586958.522439:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+16:10491:x1875469110631168:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:3.0:1788586958.522474:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586958.522577:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81079c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.522753:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9aa1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.522772:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.522787:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9aa1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586958.522889:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788586958.523102:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81079c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.523127:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81079c expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.523136:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:3.0:1788586958.523139:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788586958.523143:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecde00, rc 0) 00000100:00100000:3.0:1788586958.523231:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110631168:12345-192.168.203.1@tcp:101:rm.0 Request processed in 815us (1079us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788586958.523241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:2.0:1788586958.526969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.527113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110631296 00000100:00100000:3.0:1788586958.527128:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110631296 00000100:00100000:3.0:1788586958.527201:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:3.0:1788586958.527213:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110631296:12345-192.168.203.1@tcp:41:rm.0 00000004:00000024:3.0:1788586958.527290:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788586958.527384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110631296:12345-192.168.203.1@tcp:41:rm.0 Request processed in 172us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586958.527394:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:2.0:1788586958.530227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.530326:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110631424 00000100:00100000:3.0:1788586958.530339:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110631424 00000100:00100000:3.0:1788586958.530442:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 37 00000100:00100000:3.0:1788586958.530455:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110631424:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:3.0:1788586958.530625:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586958.530976:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9aaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107a3 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531069:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531090:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531106:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531122:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531140:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531147:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531264:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531273:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531280:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586958.531326:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788586958.531331:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586958.531357:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531371:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531379:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531385:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531392:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531409:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586958.531682:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531693:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531717:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:2.0:1788586958.531720:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586958.531726:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531733:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fd9ab6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531751:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531756:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531762:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531768:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586958.531770:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531777:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531797:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f5ba19c9200) 00010000:00010000:2.0:1788586958.531800:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586958.531869:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531877:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fd9abd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531913:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9aaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107a3 expref: 20 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531928:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107a3 expref: 19 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586958.531935:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:2.0:1788586958.531938:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586958.531940:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051a00, rc 0) 00000100:00100000:2.0:1788586958.532076:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+19:10491:x1875469110631424:12345-192.168.203.1@tcp:101:rm.0 Request processed in 1621us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586958.532087:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 37 00000100:00100000:1.0:1788586958.536253:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.536333:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110631680 00000100:00100000:3.0:1788586958.536347:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110631680 00000100:00100000:0.0:1788586958.536499:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:0.0:1788586958.536524:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:10491:x1875469110631680:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:0.0:1788586958.536601:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788586958.536649:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9ac4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107a3 expref: 19 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.536680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9a70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810787 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.536704:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:0.0:1788586958.536717:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9a85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81078e expref: 17 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.536728:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:0.0:1788586958.536731:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586958.536760:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.536777:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.536788:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.536800:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.537079:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.537111:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.537236:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.537246:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.537253:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788586958.538224:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788586958.538241:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304468824494ns, next at 305468820850ns, rc = 0 00010000:00010000:0.0:1788586958.538311:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538324:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538335:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538344:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538351:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538358:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538548:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788586958.538576:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538583:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538590:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538596:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.538601:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538609:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.538707:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:0.0:1788586958.540982:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788586958.541008:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541022:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9ad9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541063:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541070:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541077:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541104:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586958.541109:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541118:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541137:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:0.0:1788586958.541140:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586958.541143:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541149:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9acb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788586958.541163:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000165aa242 reply state 0000000060fe8199 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541177:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586958.541185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f5ba19c9200) 00010000:00010000:0.0:1788586958.541188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788586958.541192:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788586958.541322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110631680:12345-192.168.203.1@tcp:36:rm.0 Request processed in 4795us (5077us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788586958.541332:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:0.0:1788586958.547527:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586958.547633:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110631936 00000100:00100000:2.0:1788586958.547649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110631936 00000100:00100000:2.0:1788586958.547733:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:2.0:1788586958.547748:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110631936:12345-192.168.203.1@tcp:35:rm.0 00000100:00100000:2.0:1788586958.548107:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:10491:x1875469110631936:12345-192.168.203.1@tcp:35:rm.0 Request processed in 361us (595us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788586958.548116:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:2.0:1788586958.551151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586958.551672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632192 00000100:00100000:3.0:1788586958.551692:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632192 00000100:00100000:3.0:1788586958.551786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:3.0:1788586958.551800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+19:10491:x1875469110632192:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:3.0:1788586958.551890:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788586958.551926:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9aa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81079c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.551958:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9a3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810779 expref: 18 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.551974:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:3.0:1788586958.552244:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9a00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81076b expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552260:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788586958.552268:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586958.552306:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552322:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552334:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552370:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552378:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552385:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552576:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552585:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.552593:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.552953:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586958.552964:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.552972:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788586958.552978:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.552987:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.553014:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:1.0:1788586958.553018:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788586958.553023:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586958.553029:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9ae0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586958.553474:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788586958.553496:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553505:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553511:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553517:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecda00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586958.553521:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553544:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553554:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f5a834c0b00) 00010000:00010000:3.0:1788586958.553556:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788586958.553560:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553566:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecda00/0xfbc93bbea5fd9af5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553591:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553598:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553605:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553610:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586958.553626:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553632:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553640:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a834c0300) 00010000:00010000:3.0:1788586958.553643:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788586958.553646:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553662:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc600/0xfbc93bbea5fd9ae7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788586958.553679:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9b1a01b reply state 00000000d3a292bd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553693:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586958.553711:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f5a834c0900) 00010000:00010000:3.0:1788586958.553714:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788586958.553718:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788586958.553847:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+18:10491:x1875469110632192:12345-192.168.203.1@tcp:36:rm.0 Request processed in 2047us (2714us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788586958.553857:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 39 00010000:00010000:2.0:1788586958.554892:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586958.554898:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586958.554901:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586959.188922:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586959.192232:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127484672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586959.192340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586959.193064:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484672 00000100:00100000:1.0:1788586959.193077:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484672 00000100:00100000:2.0:1788586959.193088:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127484544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586959.193137:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586959.193180:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484544 00000100:00100000:2.0:1788586959.193184:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484544 00000100:00080000:0.0:1788586959.193222:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586959.193236:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788586959.193248:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127484544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586959.193279:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586959.193287:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788586959.193298:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127484672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788586959.193313:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586959.193355:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127484544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586959.193363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788586959.193486:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb04380 x1875469127484544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586959.193508:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127484544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586959.193613:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127484672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 318us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586959.193636:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788586959.193808:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca7aa00 x1875469127484672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586959.193822:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127484672:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788586959.316834:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586959.466646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586959.466705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586959.466737:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586959.466768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586959.466790:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586959.466946:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586959.466977:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632448 00000100:00100000:0.0:1788586959.466990:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632448 00000100:00100000:3.0:1788586959.467012:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632960 00000100:00100000:3.0:1788586959.467019:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632960 00000100:00100000:0.0:1788586959.467048:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632576 00000100:00100000:0.0:1788586959.467052:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632576 00000100:00100000:3.0:1788586959.467064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632832 00000100:00100000:3.0:1788586959.467069:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632832 00000100:00100000:0.0:1788586959.467082:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 177 00000100:00100000:0.0:1788586959.467096:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110632448:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586959.467109:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 178 00000100:00100000:3.0:1788586959.467121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110632960:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586959.467190:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632704 00000100:00100000:1.0:1788586959.467195:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632704 00000100:00100000:1.0:1788586959.467230:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:1.0:1788586959.467238:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110632704:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586959.467591:0:10048:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788586959.467604:0:10048:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788586959.467955:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 179 00000100:00100000:2.0:1788586959.467967:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110632576:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586959.470482:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110632448:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 3372us (3894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586959.470504:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 177 00000100:00100000:0.0:1788586959.470556:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788586959.470570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 180 00000100:00100000:0.0:1788586959.470586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110632832:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586959.470647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110632832:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 69us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586959.470676:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 180 00000100:00100000:0.0:1788586959.470729:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110632320 00000100:00100000:0.0:1788586959.470739:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110632320 00000100:00100000:0.0:1788586959.470783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 330 00000100:00100000:0.0:1788586959.470790:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110632320:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586959.471079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110632320:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 289us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586959.471087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 330 00000100:00080000:0.0:1788586959.471123:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586959.471131:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586959.476596:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110632960:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 9459us (9838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586959.476616:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 178 00000100:00100000:1.0:1788586959.477019:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110632704:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 9777us (10308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586959.477032:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:2.0:1788586959.487338:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110632576:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 19355us (20528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586959.487361:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 179 00000100:00100000:2.0:1788586960.213448:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586960.213484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127484800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586960.213579:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586960.213661:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484800 00000100:00100000:2.0:1788586960.213672:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484800 00000100:00100000:2.0:1788586960.213751:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788586960.213777:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127484800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788586960.213819:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586960.213872:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127484800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586960.213880:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788586960.213904:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586960.213952:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca7aa00 x1875469127484800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586960.213976:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127484800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586960.214118:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586960.214129:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127484928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586960.214167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586960.214207:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127484928 00000100:00100000:1.0:1788586960.214212:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127484928 00000100:00100000:1.0:1788586960.214243:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788586960.214250:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127484928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788586960.214261:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586960.214294:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127484928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586960.214300:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788586960.214327:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbca78000 x1875469127484928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586960.214340:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127484928:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788586960.214411:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586960.218314:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127485056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586960.218456:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586960.222396:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485056 00000100:00100000:2.0:1788586960.222436:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485056 00000100:00100000:2.0:1788586960.222525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788586960.222539:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127485056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586960.222590:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586960.223712:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127485056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1170us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586960.223725:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788586960.223879:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127485056:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788586960.341107:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586961.372382:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586961.748885:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586961.748919:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127485184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586961.749029:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586961.749580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485184 00000100:00100000:3.0:1788586961.749593:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485184 00000100:00100000:3.0:1788586961.749669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788586961.749691:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127485184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586961.749756:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586961.749846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127485184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586961.749854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788586961.754109:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127485184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586962.261327:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127485440:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261396:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586962.261476:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127485952:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261498:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586962.261519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127486464:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261541:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586962.261566:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788586962.261580:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127485568:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261606:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586962.261623:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127486080:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261642:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586962.261659:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127486592:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261687:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586962.261716:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485440 00000100:00100000:2.0:1788586962.261723:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485440 00000100:00100000:2.0:1788586962.261758:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485952 00000100:00100000:2.0:1788586962.261761:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485952 00000100:00100000:2.0:1788586962.261796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486464 00000100:00100000:2.0:1788586962.261800:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486464 00000100:00100000:2.0:1788586962.261812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486080 00000100:00100000:2.0:1788586962.261814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486080 00000100:00100000:2.0:1788586962.261825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486592 00000100:00100000:2.0:1788586962.261828:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486592 00000100:00100000:2.0:1788586962.261841:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788586962.261848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127485440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261897:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127485440:12345-0@lo:400:kworker.0 Request processed in 49us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.261905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788586962.261920:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788586962.261926:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127485952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.261956:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127485952:12345-0@lo:400:kworker.0 Request processed in 31us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.261963:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788586962.261973:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788586962.261990:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127486464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262188:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127486464:12345-0@lo:400:kworker.0 Request processed in 208us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.262194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788586962.262207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788586962.262213:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127486080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262237:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127486080:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.262243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788586962.262253:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788586962.262258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127486592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262282:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127486592:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.262288:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788586962.262307:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485568 00000100:00100000:2.0:1788586962.262311:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485568 00000100:00100000:2.0:1788586962.262337:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788586962.262344:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127485568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262375:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127485568:12345-0@lo:400:kworker.0 Request processed in 31us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.262381:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788586962.262403:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586962.262407:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586962.262462:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127485568:0@lo:400:kworker.0 00010000:00080000:2.0:1788586962.262475:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83cab800 x1875469127486080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586962.262499:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127486080:0@lo:400:kworker.0 00010000:00080000:2.0:1788586962.262511:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ca9880 x1875469127486592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586962.262519:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127486592:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262529:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127485440:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262539:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127485952:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.262547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127486464:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127485312:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262715:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.262750:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127485824:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.262800:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127486336:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262822:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.262838:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127486848:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262857:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.262879:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788586962.262895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.262937:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127486208:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.262958:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.262975:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127486720:0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485312 00000100:00100000:2.0:1788586962.263195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485312 00000100:00100000:2.0:1788586962.263229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788586962.263236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127485312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263272:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127485312:12345-0@lo:400:kworker.0 Request processed in 36us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.263278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788586962.263304:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485824 00000100:00100000:2.0:1788586962.263308:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485824 00000100:00100000:2.0:1788586962.263328:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788586962.263334:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127485824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263367:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127485824:12345-0@lo:400:kworker.0 Request processed in 33us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.263373:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788586962.263391:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127485696 00000100:00100000:2.0:1788586962.263394:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127485696 00000100:00100000:2.0:1788586962.263453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788586962.263460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127485696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263491:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127485696:12345-0@lo:400:kworker.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.263497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788586962.263531:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486336 00000100:00100000:2.0:1788586962.263535:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486336 00000100:00100000:2.0:1788586962.263564:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486848 00000100:00100000:2.0:1788586962.263567:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486848 00000100:00100000:2.0:1788586962.263580:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486208 00000100:00100000:2.0:1788586962.263583:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486208 00000100:00100000:2.0:1788586962.263596:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788586962.263602:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127486336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263633:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127486336:12345-0@lo:400:kworker.0 Request processed in 32us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.263640:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788586962.263651:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788586962.263657:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127486848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263696:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127486848:12345-0@lo:400:kworker.0 Request processed in 40us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.263703:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788586962.263713:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788586962.263719:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127486208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586962.263745:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127486208:12345-0@lo:400:kworker.0 Request processed in 27us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.263751:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788586962.263767:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586962.263893:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586962.263923:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127485312:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.263935:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127485824:0@lo:400:kworker.0 00010000:00080000:0.0:1788586962.263947:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83cabb80 x1875469127486336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586962.263958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127486336:0@lo:400:kworker.0 00010000:00080000:0.0:1788586962.263969:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ca8000 x1875469127486848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586962.263996:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127486848:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.264027:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127485696:0@lo:400:kworker.0 00010000:00080000:0.0:1788586962.264037:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ca8e00 x1875469127486208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586962.264047:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127486208:0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.264067:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127486720 00000100:00100000:0.0:1788586962.264070:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127486720 00000100:00100000:0.0:1788586962.264093:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788586962.264099:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127486720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586962.264132:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127486720:12345-0@lo:400:kworker.0 Request processed in 33us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586962.264145:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788586962.264176:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ca9c00 x1875469127486720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586962.264185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127486720:0@lo:400:kworker.0 00000100:00080000:2.0:1788586962.264510:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586962.264514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788586962.391411:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586962.841237:0:13680:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788586963.413570:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788586963.729263:0:13728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffd00e670 20000000:00000080:3.0:1788586963.729281:0:13728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5a83c95000 uarg=0000000000000000 20000000:01000000:3.0:1788586963.729327:0:13728:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788586963.729334:0:13728:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788586963.729339:0:13728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788586963.730203:0:13729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788586963.730364:0:13728:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788586963.735529:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788586963.735589:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788586963.735609:0:13728:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788586963.735627:0:13728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788586963.735645:0:13728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735674:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735683:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735690:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735697:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735707:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735727:0:13728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735735:0:13728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735772:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735787:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 12 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.735801:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127486976:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586963.735915:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735924:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.735932:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487104:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586963.735965:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.735973:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 23 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.735982:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487232:0@lo:104: 00000100:00100000:3.0:1788586963.736027:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586963.736083:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788586963.736096:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127487232 00000100:00100000:3.0:1788586963.736102:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127487232 00000100:00100000:3.0:1788586963.736309:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788586963.736318:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127487232:12345-0@lo:104: 00010000:00010000:3.0:1788586963.736331:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.736374:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586963.736379:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127487232:12345-0@lo:104: Request processed in 63us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586963.736386:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788586963.736482:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.736491:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 23 pid: 6515 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.736499:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487360:0@lo:104: 00000100:00100000:3.0:1788586963.736522:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586963.736545:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127487360 00000100:00100000:3.0:1788586963.736550:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127487360 00000100:00100000:3.0:1788586963.736570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788586963.736577:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127487360:12345-0@lo:104: 00010000:00010000:3.0:1788586963.736586:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.736626:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586963.736631:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127487360:12345-0@lo:104: Request processed in 56us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586963.736646:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1788586963.736689:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.736698:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 23 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736704:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788586963.736709:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487488:0@lo:104: 00010000:00010000:0.0:1788586963.736714:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736724:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050c00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788586963.736728:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.736737:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586963.736739:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586963.736748:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586963.736755:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788586963.736761:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127487488 00000100:00100000:3.0:1788586963.736766:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127487488 00010000:00010000:0.0:1788586963.736786:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.736793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1788586963.736799:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788586963.736804:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127487488:12345-0@lo:104: 00010000:00010000:3.0:1788586963.736814:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736823:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736832:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050c00/0xfbc93bbea5fd99b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd99ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.736853:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788586963.736853:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788586963.736857:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.736862:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127487488:12345-0@lo:104: Request processed in 59us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1788586963.736868:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd600 already unused, calling callback (ffffffffc13dec20) 00000100:00100000:3.0:1788586963.736873:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 10000000:00010000:0.0:1788586963.736873:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736883:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586963.736890:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586963.736895:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788586963.736901:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586963.736908:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.736915:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050a00 already unused, calling callback (ffffffffc13dec20) 00010000:00010000:0.0:1788586963.736917:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586963.736920:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736934:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586963.736938:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736943:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736959:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecd600/0xfbc93bbea5fd99a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd99ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586963.736964:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.736972:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788586963.736973:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586963.736976:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586963.736980:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586963.736988:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586963.736993:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.737001:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788586963.737006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127487616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788586963.737024:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.737033:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586963.737034:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050a00/0xfbc93bbea5fd9997 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd999e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.737047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586963.737049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586963.737051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586963.737063:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586963.737064:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127487872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788586963.737072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127487744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788586963.737105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586963.737152:0:13728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.737161:0:13728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 23 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.737172:0:13728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127488000:0@lo:104: 00000100:00100000:0.0:1788586963.737174:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586963.737205:0:13728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586963.737222:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127487616 00000100:00100000:0.0:1788586963.737228:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127487616 00000100:00100000:3.0:1788586963.737235:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488000 00000100:00100000:3.0:1788586963.737241:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488000 00010000:00010000:0.0:1788586963.737251:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 24 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.737280:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127487872 00000100:00100000:3.0:1788586963.737282:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788586963.737285:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127487872 00000100:00100000:3.0:1788586963.737293:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127488000:12345-0@lo:104: 00010000:00010000:0.0:1788586963.737301:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 25 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.737302:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.737324:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127487744 00000100:00100000:0.0:1788586963.737328:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127487744 00010000:00010000:0.0:1788586963.737342:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 26 pid: 6515 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.737353:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586963.737358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788586963.737364:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+3:13728:x1875469127488000:12345-0@lo:104: Request processed in 71us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586963.737371:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+26:3646:x1875469127487616:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788586963.737376:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788586963.737385:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586963.737392:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 26 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.737399:0:13728:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac300 going to sleep for 11 seconds 00010000:00010000:0.0:1788586963.737402:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 26 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.737435:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487232:0@lo:104: 00000100:00100000:3.0:1788586963.737442:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487360:0@lo:104: 00000100:00100000:3.0:1788586963.737446:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487488:0@lo:104: 00000100:00100000:3.0:1788586963.737449:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127488000:0@lo:104: 00010000:00010000:0.0:1788586963.738773:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4c00/0xfbc93bbea5fd99ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd99b3 expref: 26 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.738804:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586963.738864:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+25:3646:x1875469127487616:12345-0@lo:103:ldlm_bl.0 Request processed in 1496us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586963.738874:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788586963.738901:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788586963.738910:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127487872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788586963.738924:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586963.738930:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 24 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.738939:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 24 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.738952:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030c00/0xfbc93bbea5fd999e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9997 expref: 24 pid: 6514 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.738959:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586963.738992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3648:x1875469127487872:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586963.738999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788586963.739011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788586963.739019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3646:x1875469127487744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788586963.739027:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586963.739032:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 22 pid: 6515 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.739041:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 22 pid: 6515 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.739059:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80031000/0xfbc93bbea5fd99ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd99a5 expref: 22 pid: 6515 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.739069:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586963.739096:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3646:x1875469127487744:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586963.739103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788586963.739895:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127487744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788586963.739908:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127487616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788586963.739991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127487872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788586963.740034:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586963.740042:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740150:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788586963.740155:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740165:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586963.740173:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586963.740178:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586963.740286:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740292:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586963.740308:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740323:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2050800/0xfbc93bbea5fd9989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fd9990 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740340:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586963.740341:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586963.740343:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586963.740357:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127488128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788586963.740405:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586963.740486:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488128 00000100:00100000:0.0:1788586963.740492:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488128 00010000:00010000:0.0:1788586963.740517:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 21 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.740541:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788586963.740549:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3649:x1875469127488128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788586963.740560:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586963.740564:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 21 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740575:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 21 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740587:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030200/0xfbc93bbea5fd9990 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fd9989 expref: 21 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.740598:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586963.740638:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3649:x1875469127488128:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586963.740650:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788586963.741246:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127488128:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1788586963.742710:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788586963.742726:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788586963.742741:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742750:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742755:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742768:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586963.742772:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742778:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742792:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f5ba19c9200) 00010000:00010000:1.0:1788586963.742794:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586963.742921:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742949:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9a54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742971:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742977:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742982:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742986:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586963.742989:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.742995:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743004:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f5a834c0700) 00010000:00010000:1.0:1788586963.743007:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586963.743010:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743016:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9a69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743034:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743040:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.743057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788586963.743076:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127488256:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788586963.743117:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743123:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586963.743126:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743132:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743141:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f5ba19c9200) 00010000:00010000:1.0:1788586963.743143:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586963.743146:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743151:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ad2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743167:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743174:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743180:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743185:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586963.743187:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743210:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743219:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f5a834c0900) 00010000:00010000:1.0:1788586963.743221:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586963.743224:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.743230:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9aee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.743409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586963.743563:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488256 00000100:00100000:2.0:1788586963.743655:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488256 00000100:00100000:2.0:1788586963.743710:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788586963.743964:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127488256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788586963.743992:0:10047:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788586963.744024:0:10047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9babce, atime: 0x6a9babce, ctime: 0x6a9babce, blocks: 0x0 00010000:00010000:2.0:1788586963.744031:0:10047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586963.744046:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1788586963.744051:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586963.744058:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586963.744077:0:10047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586963.744087:0:10047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586963.744096:0:10047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586963.744124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586963.744163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586963.744214:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633088 00000100:00100000:0.0:1788586963.744219:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633088 00010000:00010000:0.0:1788586963.744242:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 13 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586963.744293:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633216 00000100:00100000:0.0:1788586963.744296:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633216 00010000:00010000:0.0:1788586963.744308:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 14 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586963.744336:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:1.0:1788586963.744345:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+14:2408:x1875469110633088:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586963.744356:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586963.744363:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 14 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744376:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 14 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.744391:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127486976:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586963.744392:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecca00/0xfbc93bbea5fd99c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81075d expref: 14 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586963.744411:0:13728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13728:1875469127487104:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586963.744411:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586963.744488:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110633088:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 144us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586963.744506:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:1.0:1788586963.744524:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:1.0:1788586963.744531:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+12:2408:x1875469110633216:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586963.744538:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586963.744543:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744551:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744560:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecc400/0xfbc93bbea5fd99c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810756 expref: 12 pid: 6516 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744571:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744579:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744592:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744598:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744604:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744620:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744632:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788586963.744636:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744642:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744650:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586963.744672:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586963.744692:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+11:2408:x1875469110633216:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 161us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586963.744700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 51 00010000:00010000:2.0:1788586963.744724:0:10047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788586963.744878:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127488256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1159us (1468us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788586963.744888:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788586963.745001:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586963.745007:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.745016:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788586963.745019:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.745027:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.745041:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.745059:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fd9b03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586963.745077:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586963.745079:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586963.745081:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788586963.745153:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a83605f80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788586963.745160:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127488256:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788586963.745251:0:13728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.745260:0:13728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.745266:0:13728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586963.745271:0:13728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecc600/0xfbc93bbea5fd9afc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586964.308649:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127488384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586964.308728:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586964.309015:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488384 00000100:00100000:1.0:1788586964.309024:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488384 00000100:00100000:1.0:1788586964.309084:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788586964.309095:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127488384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788586964.309123:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586964.309278:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127488384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 184us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586964.309286:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788586964.309976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127488512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586964.310012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586964.310072:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488512 00000100:00100000:1.0:1788586964.310077:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488512 00000100:00100000:1.0:1788586964.310110:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788586964.310118:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127488512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586964.310132:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586964.310244:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127488512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586964.310253:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788586964.310297:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127488512:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788586964.310532:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586964.310561:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127488384:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788586964.439285:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788586964.498453:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb434ea80 20000000:00000080:2.0:1788586964.498471:0:13778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5bbcbf4c00 uarg=0000000000000000 20000000:01000000:2.0:1788586964.498519:0:13778:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788586964.498527:0:13778:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788586964.498532:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788586964.501110:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788586964.501298:0:13778:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788586964.501393:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788586964.501451:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788586964.501468:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788586964.501480:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788586964.501501:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501516:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501527:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501534:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501542:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501562:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501569:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788586964.501573:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.501582:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.502708:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.502725:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586964.502732:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fd9b0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586964.584922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586964.584966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586964.584987:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586964.585005:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586964.585025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586964.585048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586964.585074:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633600 00000100:00100000:3.0:1788586964.585083:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633600 00000100:00100000:3.0:1788586964.585136:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633856 00000100:00100000:3.0:1788586964.585138:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633856 00000100:00100000:3.0:1788586964.585149:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633472 00000100:00100000:3.0:1788586964.585151:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633472 00000100:00100000:3.0:1788586964.585161:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633984 00000100:00100000:3.0:1788586964.585163:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633984 00000100:00100000:3.0:1788586964.585176:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 187 00000100:00100000:3.0:1788586964.585184:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110633600:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586964.585250:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110633600:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586964.585257:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 187 00000100:00100000:3.0:1788586964.585272:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 188 00000100:00100000:3.0:1788586964.585277:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110633856:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586964.585297:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110633856:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 20us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586964.585313:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 188 00000100:00100000:3.0:1788586964.585324:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 189 00000100:00100000:3.0:1788586964.585329:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110633472:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586964.585352:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110633472:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586964.585358:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 189 00000100:00100000:3.0:1788586964.585367:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 190 00000100:00100000:3.0:1788586964.585372:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110633984:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586964.585392:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110633984:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 20us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586964.585397:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 190 00000100:00100000:3.0:1788586964.585449:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633728 00000100:00100000:3.0:1788586964.585453:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633728 00000100:00100000:3.0:1788586964.585484:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:3.0:1788586964.585490:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110633728:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586964.585516:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110633728:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586964.585523:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00080000:3.0:1788586964.585541:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586964.585545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788586964.585547:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586964.585793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110633344 00000100:00100000:1.0:1788586964.585798:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110633344 00000100:00100000:1.0:1788586964.585829:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 332 00000100:00100000:1.0:1788586964.585836:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+11:2406:x1875469110633344:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586964.585863:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+11:2406:x1875469110633344:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586964.585868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 332 10000000:01000000:1.0:1788586965.270901:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788586965.270909:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bbcb3b800 from 7 10000000:01000000:1.0:1788586965.270914:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788586965.270966:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586965.270979:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586965.270990:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586965.271033:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127488640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586965.271103:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586965.271241:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a836f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.274449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488640 00000100:00100000:0.0:1788586965.274475:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488640 00000100:00100000:0.0:1788586965.274543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788586965.274553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:6518:x1875469127488640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586965.274569:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586965.274861:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9b18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9b11 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.274893:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b11 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.274905:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b11 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.274914:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7600, rc 0) 00000100:00100000:0.0:1788586965.275006:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127488640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 454us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.275013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788586965.275144:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127488640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586965.275164:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.275197:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586965.275299:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127488768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.275334:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.275376:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbacd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.275445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488768 00000100:00100000:2.0:1788586965.275450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488768 00000100:00100000:2.0:1788586965.275484:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788586965.275492:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127488768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586965.275638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127488768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.275645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788586965.276006:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127488768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.276038:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127488896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.276077:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.276105:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbacd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.276158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127488896 00000100:00100000:0.0:1788586965.276163:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127488896 00000100:00100000:0.0:1788586965.276182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788586965.276194:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127488896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.276348:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127488896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.276354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788586965.286177:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127488896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.286958:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13791:1875469127489024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.287038:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.287085:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac780 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.287146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489024 00000100:00100000:2.0:1788586965.287153:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489024 00000100:00100000:2.0:1788586965.287203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788586965.287231:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:13791:x1875469127489024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586965.287357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:13791:x1875469127489024:12345-0@lo:502:llog_process_th.0 Request processed in 138us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.287366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788586965.287563:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13791:1875469127489024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586965.287589:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.287598:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.287609:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.287616:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5bbcb3b800 00000020:00000080:3.0:1788586965.287619:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788586965.287686:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586965.287697:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.287699:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.287702:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.287705:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.287712:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788586965.287717:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5bbcb3b800 00000020:00000080:3.0:1788586965.287719:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788586965.287756:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13791:1875469127489152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.289002:0:13791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.289038:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac780 going to sleep for 11 seconds 00000100:00100000:3.0:1788586965.289076:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489152 00000100:00100000:3.0:1788586965.289081:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489152 00000100:00100000:3.0:1788586965.289117:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788586965.289125:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:13791:x1875469127489152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.291085:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:13791:x1875469127489152:12345-0@lo:502:llog_process_th.0 Request processed in 1954us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.291098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788586965.291340:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13791:1875469127489152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586965.291376:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586965.291384:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586965.291387:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788586965.291391:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788586965.291849:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788586965.291872:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788586965.291883:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.291895:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586965.291905:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788586965.291907:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bae583000 from 7 10000000:01000000:3.0:1788586965.291910:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788586965.291945:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.291952:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.291977:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586965.292000:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.292049:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.292080:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.292449:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489280 00000100:00100000:0.0:1788586965.292464:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489280 00000100:00100000:0.0:1788586965.292503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788586965.292511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:6518:x1875469127489280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586965.292522:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586965.292534:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6800/0xfbc93bbea5fd9b26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9b1f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.292554:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6800/0xfbc93bbea5fd9b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b1f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.292565:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa6800/0xfbc93bbea5fd9b26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b1f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.292583:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6800, rc 0) 00000100:00100000:0.0:1788586965.292632:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127489280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.292638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788586965.293899:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586965.293921:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.293930:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586965.294007:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.294050:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.294087:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.294912:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489408 00000100:00100000:2.0:1788586965.294923:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489408 00000100:00100000:2.0:1788586965.294977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788586965.294988:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127489408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586965.295170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127489408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.295177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788586965.295808:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.295873:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.295931:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586965.295965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489536 00000100:00100000:3.0:1788586965.295971:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.295972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489536 00000100:00100000:0.0:1788586965.296010:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788586965.296019:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127489536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.296111:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127489536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.296126:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788586965.298781:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.302554:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13793:1875469127489664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.302898:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.302988:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac480 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.310755:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489664 00000100:00100000:2.0:1788586965.310778:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489664 00000100:00100000:2.0:1788586965.310848:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788586965.310859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:13793:x1875469127489664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586965.311033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:13793:x1875469127489664:12345-0@lo:502:llog_process_th.0 Request processed in 175us (8134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.311042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788586965.312947:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13793:1875469127489664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586965.312991:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.313001:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.313004:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.313010:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5bae583000 00000020:00000080:3.0:1788586965.313013:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788586965.313115:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586965.313119:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.313121:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.313123:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.313126:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.313127:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788586965.313131:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5bae583000 00000020:00000080:3.0:1788586965.313133:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788586965.316277:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13793:1875469127489792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.316357:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.316395:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac480 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.316517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489792 00000100:00100000:2.0:1788586965.316525:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489792 00000100:00100000:2.0:1788586965.316576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788586965.316586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:13793:x1875469127489792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586965.316728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:13793:x1875469127489792:12345-0@lo:502:llog_process_th.0 Request processed in 142us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.316735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788586965.317194:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13793:1875469127489792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586965.317242:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586965.317249:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.317251:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788586965.317254:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788586965.317558:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788586965.317591:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586965.317611:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.317621:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586965.317631:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586965.317633:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5baaa5e000 from 7 10000000:01000000:2.0:1788586965.317636:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586965.317675:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.317683:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.317906:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586965.317926:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586965.317971:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586965.318006:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b832623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.318052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127489920 00000100:00100000:0.0:1788586965.318058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127489920 00000100:00100000:0.0:1788586965.318099:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788586965.318108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:6518:x1875469127489920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586965.318119:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586965.318131:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9b34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9b2d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.318152:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b2d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.318162:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b2d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.318171:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6400, rc 0) 00000100:00100000:0.0:1788586965.318226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127489920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.318233:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788586965.318303:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127489920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586965.318317:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.318326:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586965.318395:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.318456:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.318475:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.318594:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490048 00000100:00100000:0.0:1788586965.318609:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490048 00000100:00100000:0.0:1788586965.318640:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788586965.318648:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127490048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.319043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127490048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 395us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.319051:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788586965.319116:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.319147:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.319185:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.319207:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.319304:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490176 00000100:00100000:0.0:1788586965.319315:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490176 00000100:00100000:0.0:1788586965.319349:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788586965.319357:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127490176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.319458:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127490176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.319464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788586965.319543:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.320138:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13795:1875469127490304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.320178:0:13795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.320212:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac780 going to sleep for 11 seconds 00000100:00100000:0.0:1788586965.320317:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490304 00000100:00100000:0.0:1788586965.320323:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490304 00000100:00100000:0.0:1788586965.320357:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788586965.320365:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:13795:x1875469127490304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586965.320815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:13795:x1875469127490304:12345-0@lo:502:llog_process_th.0 Request processed in 449us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.320824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788586965.320970:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13795:1875469127490304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586965.320995:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.321005:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.321008:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.321014:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5baaa5e000 00000020:00000080:3.0:1788586965.321017:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788586965.321068:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586965.321311:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.321313:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.321317:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.321321:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.321322:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788586965.321326:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5baaa5e000 00000020:00000080:3.0:1788586965.321328:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788586965.321556:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13795:1875469127490432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.321620:0:13795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.321638:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac780 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.322458:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490432 00000100:00100000:2.0:1788586965.322468:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490432 00000100:00100000:2.0:1788586965.322514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788586965.322523:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:13795:x1875469127490432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586965.323146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:13795:x1875469127490432:12345-0@lo:502:llog_process_th.0 Request processed in 622us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.323154:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788586965.323889:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13795:1875469127490432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586965.323925:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586965.323932:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.323935:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788586965.323938:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788586965.324147:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788586965.324169:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586965.324179:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.324190:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586965.324200:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788586965.324203:0:6518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5b86e73000 from 7 10000000:01000000:0.0:1788586965.324206:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788586965.324246:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.324255:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.324263:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586965.324295:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.324339:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586965.324373:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb10a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.324889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490560 00000100:00100000:2.0:1788586965.324897:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490560 00000100:00100000:2.0:1788586965.324946:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788586965.324955:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:6518:x1875469127490560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586965.324968:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586965.324981:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bc2051c00/0xfbc93bbea5fd9b42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fd9b3b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.325005:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2051c00/0xfbc93bbea5fd9b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b3b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.325016:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bc2051c00/0xfbc93bbea5fd9b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b3b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.325024:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051c00, rc 0) 00000100:00100000:2.0:1788586965.325064:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127490560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.325070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788586965.325633:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586965.325658:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586965.325668:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586965.325740:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.325773:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586965.325801:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb10a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586965.325953:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490688 00000100:00100000:3.0:1788586965.325958:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490688 00000100:00100000:3.0:1788586965.325992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788586965.326000:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127490688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.326117:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127490688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.326124:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788586965.326160:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.326190:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.326234:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.326249:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbace40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586965.326262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490816 00000100:00100000:3.0:1788586965.326266:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490816 00000100:00100000:3.0:1788586965.326289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788586965.326296:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127490816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.326373:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:6518:x1875469127490816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.326380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788586965.326447:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:47977fce-e1b1-4b0c-879f-0e023b1316c2:6518:1875469127490816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.326639:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13796:1875469127490944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.326682:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.326699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127490944 00000100:00100000:3.0:1788586965.326703:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127490944 00000100:00100000:3.0:1788586965.326721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788586965.326727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:13796:x1875469127490944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.327080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:13796:x1875469127490944:12345-0@lo:502:llog_process_th.0 Request processed in 351us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.327087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788586965.327118:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbacd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586965.327131:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13796:1875469127490944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586965.327152:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.327161:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.327164:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.327169:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5b86e73000 00000020:00000080:3.0:1788586965.327171:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788586965.327222:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586965.327516:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.327519:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788586965.327523:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586965.327527:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586965.327528:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788586965.327531:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5b86e73000 00000020:00000080:3.0:1788586965.327534:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788586965.327756:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13796:1875469127491072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586965.330149:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586965.330206:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a836fce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586965.330359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491072 00000100:00100000:2.0:1788586965.330367:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491072 00000100:00100000:2.0:1788586965.330438:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788586965.330449:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:13796:x1875469127491072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586965.330586:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:13796:x1875469127491072:12345-0@lo:502:llog_process_th.0 Request processed in 138us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.330608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788586965.331044:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:47977fce-e1b1-4b0c-879f-0e023b1316c2:13796:1875469127491072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788586965.331087:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586965.331096:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586965.331098:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788586965.331102:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788586965.331194:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788586965.331275:0:6518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788586965.331285:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.331297:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586965.332818:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586965.332840:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127491200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788586965.332902:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586965.332941:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491200 00000100:00100000:2.0:1788586965.332948:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491200 00000100:00100000:2.0:1788586965.332994:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788586965.333001:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127491200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788586965.333026:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586965.333064:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127491200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.333070:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788586965.333088:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586965.333113:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ca9180 x1875469127491200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586965.333129:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127491200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586965.333680:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127491328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586965.333719:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586965.333801:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491328 00000100:00100000:1.0:1788586965.333806:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491328 00000100:00100000:1.0:1788586965.333851:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788586965.333925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586965.333958:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127491328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788586965.333971:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586965.334016:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127491328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586965.334023:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788586965.334081:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a81be0700 x1875469127491328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586965.334097:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127491328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586965.334581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127491456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586965.334618:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586965.334688:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491456 00000100:00100000:2.0:1788586965.334703:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491456 00000100:00100000:2.0:1788586965.334747:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788586965.334755:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127491456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586965.335258:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586965.335316:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127491456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 561us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.335323:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788586965.335477:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127491456:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788586965.337474:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788586965.359709:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788586965.464825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586965.801263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586965.801366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634112 00000100:00100000:2.0:1788586965.801377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634112 00000100:00100000:2.0:1788586965.801478:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 353 00000100:00100000:2.0:1788586965.801490:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+11:6177:x1875469110634112:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586965.801510:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586965.801530:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9b49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.801563:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107aa expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.801575:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107aa expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586965.801583:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051600, rc 0) 00000100:00100000:2.0:1788586965.801654:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110634112:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.801669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 353 00000100:00100000:3.0:1788586965.808809:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586965.809200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634240 00000100:00100000:2.0:1788586965.809210:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634240 00000100:00100000:2.0:1788586965.809273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 354 00000100:00100000:2.0:1788586965.809283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110634240:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586965.809518:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110634240:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 236us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.809527:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 354 00000100:00100000:3.0:1788586965.816374:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586965.816501:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634368 00000100:00100000:0.0:1788586965.816512:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634368 00000100:00100000:0.0:1788586965.816569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 355 00000100:00100000:0.0:1788586965.816580:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110634368:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586965.816761:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110634368:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 181us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.816769:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 355 00000100:00100000:3.0:1788586965.826972:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586965.827082:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634496 00000100:00100000:2.0:1788586965.827092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634496 00000100:00100000:2.0:1788586965.827153:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 356 00000100:00100000:2.0:1788586965.827182:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+12:10775:x1875469110634496:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788586965.827343:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+12:10775:x1875469110634496:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 162us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.827351:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 356 00000100:00100000:1.0:1788586965.837480:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586965.837593:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634624 00000100:00100000:3.0:1788586965.837604:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634624 00000100:00100000:3.0:1788586965.837673:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 357 00000100:00100000:3.0:1788586965.837684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:10775:x1875469110634624:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788586965.837871:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+12:10775:x1875469110634624:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 187us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.837890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 357 00000100:00100000:1.0:1788586965.854943:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586965.855511:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634752 00000100:00100000:3.0:1788586965.855523:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634752 00000100:00100000:3.0:1788586965.855591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 358 00000100:00100000:3.0:1788586965.855602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+12:6177:x1875469110634752:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586965.855617:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586965.855636:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b91ecda00/0xfbc93bbea5fd9b50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107b1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.855681:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b91ecda00/0xfbc93bbea5fd9b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107b1 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.855917:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b91ecda00/0xfbc93bbea5fd9b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107b1 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586965.855929:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecda00, rc 0) 00000100:00100000:3.0:1788586965.857234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110634752:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 1625us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.857245:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 358 00000100:00100000:0.0:1788586965.858409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586965.858588:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110634880 00000100:00100000:2.0:1788586965.858599:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110634880 00000100:00100000:2.0:1788586965.858661:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 359 00000100:00100000:2.0:1788586965.858670:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110634880:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586965.858932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110634880:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 262us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.858939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 359 00000100:00100000:2.0:1788586965.862343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586965.862547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635008 00000100:00100000:3.0:1788586965.862567:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635008 00000100:00100000:3.0:1788586965.862621:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 360 00000100:00100000:3.0:1788586965.862632:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110635008:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586965.863240:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:6177:x1875469110635008:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 607us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.863249:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 360 00000100:00100000:3.0:1788586965.895270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586965.895681:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635136 00000100:00100000:2.0:1788586965.895691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635136 00000100:00100000:2.0:1788586965.895764:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 361 00000100:00100000:2.0:1788586965.895774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:10779:x1875469110635136:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788586965.895934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:10779:x1875469110635136:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 161us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.895942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 361 00000100:00100000:0.0:1788586965.909741:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586965.913078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635264 00000100:00100000:3.0:1788586965.913094:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635264 00000100:00100000:3.0:1788586965.916888:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 362 00000100:00100000:3.0:1788586965.916903:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:10779:x1875469110635264:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788586965.917085:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:10779:x1875469110635264:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 184us (7355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586965.917093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 362 00000040:00080000:3.0:1788586966.361153:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788586966.421116:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788586966.484776:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586966.870769:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586966.870796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127491584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586966.870872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586966.873426:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491584 00000100:00100000:3.0:1788586966.873442:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491584 00000100:00100000:3.0:1788586966.873579:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788586966.873592:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127491584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586966.873631:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586966.873732:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127491584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586966.873739:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788586966.873827:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127491584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586967.382494:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127491840:0@lo:400:kworker.0 00000100:00100000:3.0:1788586967.382495:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127491968:0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382495:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127491712:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382575:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127492096:0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382582:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586967.382608:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586967.382624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127492224:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382626:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127492608:0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382660:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586967.382660:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586967.382677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127492736:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382677:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127493120:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382696:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586967.382709:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492224 00000100:00100000:1.0:1788586967.382716:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492224 00000100:00100000:0.0:1788586967.382735:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492608 00000100:00100000:0.0:1788586967.382738:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492608 00000100:00100000:1.0:1788586967.382761:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788586967.382768:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493120 00000100:00100000:1.0:1788586967.382770:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127492224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382770:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493120 00000100:00100000:0.0:1788586967.382787:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788586967.382793:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127492608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382832:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127492224:12345-0@lo:400:kworker.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.382832:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127492608:12345-0@lo:400:kworker.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.382839:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788586967.382840:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788586967.382855:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788586967.382863:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586967.382867:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127493120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127493248:0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586967.382895:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127493120:12345-0@lo:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.382900:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788586967.382908:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492736 00000100:00100000:0.0:1788586967.382911:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492736 00000100:00100000:1.0:1788586967.382920:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127492224:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382924:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493248 00000100:00100000:0.0:1788586967.382926:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493248 00000100:00100000:0.0:1788586967.382936:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788586967.382941:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127492736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.382951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491712 00000100:00100000:1.0:1788586967.382954:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491712 00000100:00100000:0.0:1788586967.382971:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127492736:12345-0@lo:400:kworker.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586967.382977:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788586967.382977:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788586967.382982:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127491712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.382985:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788586967.382990:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127493248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.383010:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127491712:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.383010:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127493248:12345-0@lo:400:kworker.0 Request processed in 20us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586967.383017:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788586967.383017:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788586967.383040:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83728a80 x1875469127492608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586967.383041:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127491712:0@lo:400:kworker.0 00010000:00080000:1.0:1788586967.383050:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83728380 x1875469127492736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586967.383051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127492608:0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.383058:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127492736:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.383060:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127493120:0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.383066:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127493248:0@lo:400:kworker.0 00000100:00080000:1.0:1788586967.383097:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586967.383101:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586967.383107:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492096 00000100:00100000:0.0:1788586967.383111:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492096 00000100:00100000:0.0:1788586967.383135:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788586967.383141:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127492096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.383190:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127492096:12345-0@lo:400:kworker.0 Request processed in 48us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.383196:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788586967.383668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127492096:0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.386454:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586967.386571:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127492352:0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.386616:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586967.386786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127492864:0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.386828:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586967.386851:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491840 00000100:00100000:0.0:1788586967.386859:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491840 00000100:00100000:1.0:1788586967.386916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492352 00000100:00100000:1.0:1788586967.386920:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492352 00000100:00100000:1.0:1788586967.386977:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788586967.386986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.387041:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127491840:12345-0@lo:400:kworker.0 Request processed in 56us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586967.387047:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788586967.387061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788586967.387067:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127492352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.387096:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127492352:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586967.387117:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1788586967.387136:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586967.387604:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127491840:0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.387617:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127492352:0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.387706:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492864 00000100:00100000:0.0:1788586967.387711:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492864 00000100:00100000:0.0:1788586967.387743:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788586967.387749:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127492864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.387790:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127492864:12345-0@lo:400:kworker.0 Request processed in 41us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.387795:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1788586967.387810:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586967.387883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127492864:0@lo:400:kworker.0 00000100:00100000:3.0:1788586967.389622:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586967.389686:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127492480:0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.389701:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127491968 00000100:00100000:2.0:1788586967.389711:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127491968 00000100:00100000:3.0:1788586967.389723:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586967.389753:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127492992:0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.389775:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788586967.389776:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586967.389790:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127491968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586967.389949:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492480 00000100:00100000:0.0:1788586967.389954:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492480 00000100:00100000:0.0:1788586967.389987:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127492992 00000100:00100000:0.0:1788586967.389990:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127492992 00000100:00100000:0.0:1788586967.390009:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788586967.390016:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127492480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586967.390092:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788586967.390100:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127492992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586967.390164:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127491968:12345-0@lo:400:kworker.0 Request processed in 377us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586967.390171:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788586967.390212:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788586967.391979:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127492480:12345-0@lo:400:kworker.0 Request processed in 1956us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.391992:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788586967.392144:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127492992:12345-0@lo:400:kworker.0 Request processed in 2044us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586967.392152:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788586967.392696:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127491968:0@lo:400:kworker.0 00010000:00080000:3.0:1788586967.392720:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83729880 x1875469127492480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586967.392749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127492480:0@lo:400:kworker.0 00010000:00080000:3.0:1788586967.392766:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8372b100 x1875469127492992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586967.392775:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127492992:0@lo:400:kworker.0 00010000:00010000:1.0:1788586967.509131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586968.534597:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788586968.920166:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788586969.428646:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586969.428795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586969.428825:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127493504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586969.428899:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586969.428966:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493504 00000100:00100000:2.0:1788586969.428973:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493504 00000100:00100000:2.0:1788586969.429027:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788586969.429038:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127493504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788586969.429081:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586969.429137:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127493504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586969.429144:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788586969.429168:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586969.429221:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127493504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586969.430447:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586969.430506:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586969.430634:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493376 00000100:00100000:1.0:1788586969.430642:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493376 00000100:00100000:1.0:1788586969.430707:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788586969.430716:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127493376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586969.430740:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586969.430781:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127493376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586969.430787:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788586969.430875:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788586969.430880:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a83605f80, transno 4294967301 00000100:00080000:2.0:1788586969.430964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586969.433723:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127493376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788586969.556758:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586969.703169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586969.703222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586969.703262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586969.703293:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586969.703317:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586969.703336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586969.703363:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635520 00000100:00100000:3.0:1788586969.703372:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635520 00000100:00100000:3.0:1788586969.703462:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636032 00000100:00100000:3.0:1788586969.703465:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636032 00000100:00100000:3.0:1788586969.703480:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635648 00000100:00100000:3.0:1788586969.703482:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635648 00000100:00100000:3.0:1788586969.703494:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635904 00000100:00100000:3.0:1788586969.703497:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635904 00000100:00100000:3.0:1788586969.703512:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 197 00000100:00100000:3.0:1788586969.703522:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110635520:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586969.703605:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110635520:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 83us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586969.703612:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 197 00000100:00100000:3.0:1788586969.703643:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 198 00000100:00100000:3.0:1788586969.703649:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2407:x1875469110636032:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586969.703674:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2407:x1875469110636032:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586969.703680:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 198 00000100:00100000:3.0:1788586969.703691:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 199 00000100:00100000:3.0:1788586969.703709:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110635648:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586969.703741:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2406:x1875469110635648:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586969.703748:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 199 00000100:00100000:3.0:1788586969.703759:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 200 00000100:00100000:3.0:1788586969.703765:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110635904:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586969.703786:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110635904:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586969.703792:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 200 00000100:00100000:0.0:1788586969.703878:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635776 00000100:00100000:0.0:1788586969.703883:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635776 00000100:00100000:0.0:1788586969.703923:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 82 00000100:00100000:0.0:1788586969.703930:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110635776:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586969.703957:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110635776:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586969.703975:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 82 00000100:00080000:2.0:1788586969.704585:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586969.704590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586969.704592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586969.704604:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110635392 00000100:00100000:2.0:1788586969.704609:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110635392 00000100:00100000:2.0:1788586969.704685:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 364 00000100:00100000:2.0:1788586969.704701:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110635392:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586969.704753:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110635392:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 61us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586969.704760:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 364 00000100:00100000:1.0:1788586970.453032:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127493632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586970.453105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586970.453169:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586970.453176:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127493760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586970.453202:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586970.453230:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493632 00000100:00100000:1.0:1788586970.453237:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493632 00000100:00100000:1.0:1788586970.453290:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788586970.453300:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127493632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788586970.453329:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586970.453372:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127493632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586970.453379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788586970.453399:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586970.453445:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493760 00000100:00100000:0.0:1788586970.453447:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586970.453450:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493760 00000100:00100000:0.0:1788586970.453462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127493888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586970.453489:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788586970.453661:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127493760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788586970.453688:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788586970.453720:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127493760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 224us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586970.458597:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586970.458656:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127493888 00000100:00100000:3.0:1788586970.458666:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127493888 00000100:00100000:3.0:1788586970.458734:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788586970.458745:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127493888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586970.458771:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586970.458839:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127493888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586970.458847:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788586970.458898:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83caa300 x1875469127493888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586970.458917:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127493888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788586970.458952:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586970.458976:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127493760:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788586970.458989:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83ca9f80 x1875469127493632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586970.459012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127493632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788586970.461100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:1.0:1788586970.580946:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586971.612182:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586971.989077:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586971.989100:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127494016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586971.989166:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586971.989292:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494016 00000100:00100000:3.0:1788586971.989301:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494016 00000100:00100000:3.0:1788586971.989349:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788586971.989357:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127494016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586971.989386:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586971.989462:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127494016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586971.989469:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788586971.989700:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127494016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586972.501181:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127494528:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.501299:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127495040:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501325:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.501349:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495040 00000100:00100000:0.0:1788586972.501356:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495040 00000100:00100000:0.0:1788586972.501405:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788586972.501438:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127495040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501483:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127495040:12345-0@lo:400:kworker.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.501489:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788586972.501526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a18700 x1875469127495040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586972.501539:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127495040:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127495552:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501566:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.501586:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495552 00000100:00100000:0.0:1788586972.501589:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495552 00000100:00100000:0.0:1788586972.501622:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788586972.501629:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127495552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501656:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127495552:12345-0@lo:400:kworker.0 Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.501673:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788586972.501698:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127495552:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501715:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788586972.501721:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127494400:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501742:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.501755:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127494912:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501770:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.501782:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127495424:0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.501796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.501812:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494528 00000100:00100000:0.0:1788586972.501814:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494528 00000100:00100000:0.0:1788586972.501834:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494912 00000100:00100000:0.0:1788586972.501837:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494912 00000100:00100000:0.0:1788586972.501851:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495424 00000100:00100000:0.0:1788586972.501853:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495424 00000100:00100000:2.0:1788586972.501959:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127494272:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.501987:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.501997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127494784:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502014:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.502028:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127495296:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.502057:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788586972.502062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127494144:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502084:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.502114:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127494656:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.502143:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127495168:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502157:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.502171:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127495680:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502185:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.502203:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495168 00000100:00100000:2.0:1788586972.502206:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495168 00000100:00100000:2.0:1788586972.502222:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495680 00000100:00100000:2.0:1788586972.502224:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495680 00000100:00100000:2.0:1788586972.502238:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788586972.502244:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127495168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502276:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127495168:12345-0@lo:400:kworker.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586972.502282:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788586972.502294:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788586972.502299:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127495680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502324:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127495680:12345-0@lo:400:kworker.0 Request processed in 25us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586972.502329:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1788586972.502354:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a19500 x1875469127495168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586972.502364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127495168:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502373:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127495680:0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502433:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494144 00000100:00100000:2.0:1788586972.502443:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494144 00000100:00100000:2.0:1788586972.502469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788586972.502475:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127494144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586972.502509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127494144:12345-0@lo:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586972.502514:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788586972.502546:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127494144:0@lo:400:kworker.0 00000100:00100000:3.0:1788586972.502643:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494272 00000100:00100000:3.0:1788586972.502647:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494272 00000100:00100000:3.0:1788586972.502668:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494784 00000100:00100000:3.0:1788586972.502670:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494784 00000100:00100000:3.0:1788586972.502681:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495296 00000100:00100000:3.0:1788586972.502684:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495296 00000100:00100000:3.0:1788586972.502696:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788586972.502702:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127494528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586972.502754:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127494528:12345-0@lo:400:kworker.0 Request processed in 52us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586972.502762:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788586972.502774:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788586972.502842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788586972.502851:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127494272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.502905:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127494272:12345-0@lo:400:kworker.0 Request processed in 56us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.502916:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788586972.502929:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788586972.502935:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127494784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.502962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127494784:12345-0@lo:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.502967:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788586972.502977:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788586972.502983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127495296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.503007:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127495296:12345-0@lo:400:kworker.0 Request processed in 24us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.503012:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788586972.503040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127494272:0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.503051:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127494784:0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.503059:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127495296:0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.503080:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494400 00000100:00100000:1.0:1788586972.503084:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494400 00000100:00100000:1.0:1788586972.503112:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127494656 00000100:00100000:1.0:1788586972.503115:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127494656 00000100:00100000:2.0:1788586972.503167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127494528:0@lo:400:kworker.0 00000100:00080000:2.0:1788586972.503198:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586972.503202:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788586972.503262:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788586972.506807:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127494912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586972.507189:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127494912:12345-0@lo:400:kworker.0 Request processed in 4408us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586972.507199:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788586972.507252:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788586972.507263:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127494400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586972.507312:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127494400:12345-0@lo:400:kworker.0 Request processed in 52us (5569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586972.507319:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788586972.507380:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127494400:0@lo:400:kworker.0 00010000:00080000:3.0:1788586972.507395:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a1b800 x1875469127494912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586972.507405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127494912:0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.507716:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788586972.507724:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127494656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586972.507778:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127494656:12345-0@lo:400:kworker.0 Request processed in 54us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.507784:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788586972.507812:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127494656:0@lo:400:kworker.0 00000100:00080000:2.0:1788586972.508035:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586972.508039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586972.508074:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127495424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586972.508164:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127495424:12345-0@lo:400:kworker.0 Request processed in 4895us (6367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.508172:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00080000:3.0:1788586972.508224:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a1a300 x1875469127495424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586972.508236:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127495424:0@lo:400:kworker.0 00010000:00010000:0.0:1788586972.628653:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586973.653331:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586974.549006:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586974.549029:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127495808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586974.549100:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586974.549250:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495808 00000100:00100000:1.0:1788586974.549258:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495808 00000100:00100000:1.0:1788586974.549324:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788586974.549334:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127495808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586974.549362:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586974.549406:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127495808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586974.549413:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788586974.549574:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127495808:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788586974.549606:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788586974.552464:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127495936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586974.552543:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586974.553853:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127495936 00000100:00100000:3.0:1788586974.553864:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127495936 00000100:00100000:3.0:1788586974.554028:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788586974.554038:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127495936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788586974.554062:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586974.554132:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127495936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.554148:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788586974.554181:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127495936:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788586974.554586:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788586974.676903:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586974.832539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586974.832581:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586974.832626:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586974.832661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586974.832680:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586974.832716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586974.832791:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636288 00000100:00100000:3.0:1788586974.832803:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636288 00000100:00100000:3.0:1788586974.832869:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636800 00000100:00100000:3.0:1788586974.832872:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636800 00000100:00100000:3.0:1788586974.832885:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636416 00000100:00100000:3.0:1788586974.832888:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636416 00000100:00100000:3.0:1788586974.832898:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636672 00000100:00100000:3.0:1788586974.832901:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636672 00000100:00100000:3.0:1788586974.832914:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 207 00000100:00100000:3.0:1788586974.832924:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110636288:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586974.832998:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110636288:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 75us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.833005:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 207 00000100:00100000:3.0:1788586974.833020:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 208 00000100:00100000:3.0:1788586974.833027:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110636800:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586974.833051:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110636800:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.833071:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 208 00000100:00100000:3.0:1788586974.833084:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 209 00000100:00100000:3.0:1788586974.833091:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110636416:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586974.833115:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110636416:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.833121:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 209 00000100:00100000:3.0:1788586974.833132:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 210 00000100:00100000:3.0:1788586974.833137:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110636672:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586974.833159:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110636672:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.833164:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 210 00000100:00080000:2.0:1788586974.833473:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788586974.833478:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586974.833678:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636160 00000100:00100000:1.0:1788586974.833683:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636160 00000100:00100000:1.0:1788586974.833733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 366 00000100:00100000:1.0:1788586974.833741:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110636160:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586974.833782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110636160:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 42us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586974.833789:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 366 00000100:00100000:0.0:1788586974.834231:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636544 00000100:00100000:0.0:1788586974.834237:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636544 00000100:00100000:0.0:1788586974.834291:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 87 00000100:00100000:0.0:1788586974.834298:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110636544:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586974.834356:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110636544:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 59us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586974.834363:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 87 00000100:00080000:2.0:1788586974.834709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586975.573245:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127496192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586975.573316:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586975.573368:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496192 00000100:00100000:0.0:1788586975.573378:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496192 00000100:00080000:3.0:1788586975.573410:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586975.573456:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788586975.573467:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127496192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586975.573495:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586975.573547:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127496192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586975.573554:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788586975.573614:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127496064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586975.573646:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586975.573682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127496320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788586975.573705:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586975.573723:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496064 00000100:00100000:1.0:1788586975.573737:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496064 00000100:00100000:2.0:1788586975.573763:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496320 00000100:00100000:1.0:1788586975.573764:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788586975.573766:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496320 00000100:00100000:1.0:1788586975.573770:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127496064:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586975.573789:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000004:00000024:1.0:1788586975.573791:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586975.573794:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127496320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788586975.573803:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586975.573828:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127496320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586975.573828:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127496064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586975.573835:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788586975.573855:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788586975.573946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127496064:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788586975.573988:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb03100 x1875469127496320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586975.574002:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127496320:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788586975.574629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788586975.574654:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb05ace00 x1875469127496192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586975.574669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127496192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788586975.700837:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788586976.597117:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788586976.661125:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788586976.724702:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586977.108934:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788586977.108959:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127496448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788586977.109032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.109272:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496448 00000100:00100000:3.0:1788586977.109280:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496448 00000100:00100000:3.0:1788586977.109333:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788586977.109344:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127496448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586977.109750:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586977.109839:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127496448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 496us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.109846:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788586977.110006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127496448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586977.620817:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127496960:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.620885:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.620948:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127497472:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.620973:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.620988:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127497984:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621009:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621036:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788586977.621041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127496576:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621078:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621096:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127497088:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621118:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621135:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127497600:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621154:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621181:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497088 00000100:00100000:3.0:1788586977.621188:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497088 00000100:00100000:3.0:1788586977.621235:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497600 00000100:00100000:3.0:1788586977.621239:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497600 00000100:00100000:3.0:1788586977.621258:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788586977.621266:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127497088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621314:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127497088:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.621321:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788586977.621337:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788586977.621357:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621386:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127497600:12345-0@lo:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.621391:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1788586977.621446:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788586977.621459:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127496704:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.621467:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497472 00000100:00100000:1.0:1788586977.621471:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497472 00000100:00100000:3.0:1788586977.621482:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621497:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127497216:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.621501:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497984 00000100:00100000:1.0:1788586977.621503:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497984 00000100:00100000:3.0:1788586977.621516:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.621521:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788586977.621527:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5baf363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127497472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127497728:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621564:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788586977.621579:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a835da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127496832:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621602:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621616:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127497344:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621635:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621646:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127497856:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.621654:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5baf363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127497472:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.621662:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788586977.621663:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586977.621680:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496704 00000100:00100000:3.0:1788586977.621683:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496704 00000100:00100000:3.0:1788586977.621699:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497216 00000100:00100000:3.0:1788586977.621701:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497216 00000100:00100000:3.0:1788586977.621710:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497728 00000100:00100000:3.0:1788586977.621712:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497728 00000100:00100000:3.0:1788586977.621721:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496832 00000100:00100000:3.0:1788586977.621723:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496832 00000100:00100000:3.0:1788586977.621733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788586977.621744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127496704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621773:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127496704:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.621778:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788586977.621789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788586977.621794:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127497216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127497216:12345-0@lo:400:kworker.0 Request processed in 20us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.621819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788586977.621828:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788586977.621828:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497344 00000100:00100000:1.0:1788586977.621831:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497344 00000100:00100000:3.0:1788586977.621833:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621856:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127497728:12345-0@lo:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.621861:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788586977.621872:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788586977.621878:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127496832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621902:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127496832:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.621907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788586977.621911:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127497856 00000100:00100000:1.0:1788586977.621914:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127497856 00000100:00100000:1.0:1788586977.621927:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788586977.621932:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127497984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.621958:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127497088:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.621959:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127497984:12345-0@lo:400:kworker.0 Request processed in 27us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.621964:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788586977.621970:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127497600:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.621974:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788586977.621979:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127497344:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788586977.621982:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a18000 x1875469127497472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586977.621992:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127497472:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.622000:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127497344:12345-0@lo:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586977.622005:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788586977.622009:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127497984:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.622014:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788586977.622024:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.622037:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127496832:0@lo:400:kworker.0 00010000:00080000:3.0:1788586977.622046:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a1b800 x1875469127497344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586977.622049:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127497856:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.622055:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127497344:0@lo:400:kworker.0 00000100:00100000:1.0:1788586977.622055:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788586977.622063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.622071:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127496704:0@lo:400:kworker.0 00000100:00080000:1.0:1788586977.622076:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788586977.622078:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a1a300 x1875469127497216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788586977.622079:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586977.622081:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586977.622086:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127497216:0@lo:400:kworker.0 00010000:00080000:3.0:1788586977.622094:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a19500 x1875469127497728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586977.622102:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127497728:0@lo:400:kworker.0 00000100:00100000:0.0:1788586977.622909:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496960 00000100:00100000:0.0:1788586977.622918:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496960 00000100:00100000:0.0:1788586977.622967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788586977.622975:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127496960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586977.623033:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127496960:12345-0@lo:400:kworker.0 Request processed in 59us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.623039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788586977.623558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127496576 00000100:00100000:2.0:1788586977.623563:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127496576 00000100:00100000:2.0:1788586977.623612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788586977.623619:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127496576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586977.623656:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127496576:12345-0@lo:400:kworker.0 Request processed in 37us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.623661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788586977.623846:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127496576:0@lo:400:kworker.0 00000100:00100000:3.0:1788586977.623861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a835daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127496960:0@lo:400:kworker.0 00010000:00010000:1.0:1788586977.748716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586978.772796:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586979.669086:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127498112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586979.669156:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586979.669395:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586979.669399:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498112 00000100:00100000:0.0:1788586979.669407:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498112 00000100:00100000:0.0:1788586979.669489:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788586979.669512:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127498112:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788586979.669540:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788586979.669542:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586979.669614:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127498112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586979.669665:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127498112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586979.670313:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127498240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586979.670354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586979.671396:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498240 00000100:00100000:3.0:1788586979.671404:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498240 00000100:00080000:1.0:1788586979.671659:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586979.672059:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788586979.672095:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788586979.672105:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127498240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788586979.672129:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586979.672204:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127498240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586979.672211:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788586979.674733:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127498240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788586979.797039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586979.946669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586979.946753:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586979.946787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586979.946833:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110636928 00000100:00100000:2.0:1788586979.946843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110636928 00000100:00100000:2.0:1788586979.946916:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 368 00000100:00100000:2.0:1788586979.946928:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110636928:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586979.946995:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110636928:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586979.947002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 368 00000100:00100000:3.0:1788586979.949509:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637056 00000100:00100000:3.0:1788586979.949523:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637056 00000100:00100000:3.0:1788586979.949596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637184 00000100:00100000:3.0:1788586979.949599:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637184 00000100:00100000:3.0:1788586979.949623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 217 00000100:00100000:3.0:1788586979.949643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637056:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586979.949708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637056:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 67us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586979.949714:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 217 00000100:00100000:3.0:1788586979.949730:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 218 00000100:00100000:3.0:1788586979.949735:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637184:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586979.949754:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637184:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 19us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586979.949759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 218 00000100:00080000:1.0:1788586979.949986:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788586979.949991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586979.963165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586979.963262:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586979.963295:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586979.963379:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637568 00000100:00100000:0.0:1788586979.963389:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637568 00000100:00100000:0.0:1788586979.963493:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637440 00000100:00100000:0.0:1788586979.963496:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637440 00000100:00100000:0.0:1788586979.963518:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 219 00000100:00100000:0.0:1788586979.963527:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110637568:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586979.963603:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110637568:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 77us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586979.963611:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 219 00000100:00100000:0.0:1788586979.963627:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 220 00000100:00100000:0.0:1788586979.963633:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110637440:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586979.963674:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110637440:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 41us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586979.963693:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 220 00000100:00080000:2.0:1788586979.964154:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586979.964170:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586979.966057:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637312 00000100:00100000:1.0:1788586979.966070:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637312 00000100:00100000:1.0:1788586979.966212:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:1.0:1788586979.966222:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2405:x1875469110637312:12345-192.168.203.1@tcp:9:kworker.0 00000020:00000080:1.0:1788586979.966249:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9a77 00000100:00080000:1.0:1788586979.966256:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb23800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788586979.966305:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1788586979.966498:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+2:2405:x1875469110637312:12345-192.168.203.1@tcp:9:kworker.0 Request processed in 277us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586979.966506:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 27 00010000:00010000:0.0:1788586979.966585:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788586979.970920:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788586980.692853:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586980.692891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586980.692956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586980.693105:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498368 00000100:00100000:3.0:1788586980.693114:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498368 00000100:00100000:3.0:1788586980.693173:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788586980.693182:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127498368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788586980.693208:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586980.693252:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127498368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586980.693259:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788586980.693265:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788586980.693307:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb05adc00 x1875469127498368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586980.693330:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127498368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586980.693640:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127498496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788586980.693684:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586980.693751:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498496 00000100:00100000:2.0:1788586980.693756:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498496 00000100:00100000:2.0:1788586980.693781:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788586980.693787:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127498496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586980.693808:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788586980.694034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb05adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127498624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586980.694062:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586980.694184:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498624 00000100:00100000:3.0:1788586980.694188:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498624 00000100:00100000:3.0:1788586980.694228:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788586980.694234:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127498624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788586980.694245:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788586980.694272:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127498624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586980.694288:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1788586980.694317:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb05adc00 x1875469127498624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586980.694331:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb05adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127498624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788586980.696846:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788586980.697255:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127498496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3462us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586980.697267:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788586980.697482:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127498496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788586980.820931:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586981.844738:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586982.229286:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127498752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788586982.229366:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586982.229701:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498752 00000100:00100000:2.0:1788586982.229712:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498752 00000100:00100000:2.0:1788586982.229782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788586982.229792:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127498752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586982.229826:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586982.229881:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127498752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586982.229888:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788586982.230043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127498752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586982.741005:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127499008:0@lo:400:kworker.0 00000100:00100000:3.0:1788586982.741076:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586982.741175:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499008 00000100:00100000:2.0:1788586982.741183:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499008 00000100:00100000:2.0:1788586982.741239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788586982.741248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.741440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.741482:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.741523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127498880 00000100:00100000:1.0:1788586982.741527:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127498880 00000100:00100000:1.0:1788586982.741576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788586982.741584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127498880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.741620:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127498880:12345-0@lo:400:kworker.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.741627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788586982.741670:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.741728:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127499136:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.741756:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.741790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499136 00000100:00100000:1.0:1788586982.741793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499136 00000100:00100000:1.0:1788586982.741831:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788586982.741837:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127499136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.741871:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127499136:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.741877:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788586982.741915:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127499136:0@lo:400:kworker.0 00000100:00100000:2.0:1788586982.745125:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127499008:12345-0@lo:400:kworker.0 Request processed in 3865us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586982.745140:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788586982.745822:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127499648:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.745902:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.745934:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127500160:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.745955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.745975:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788586982.745980:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127499520:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746000:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746024:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127500032:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746043:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746071:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499520 00000100:00100000:1.0:1788586982.746078:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499520 00000100:00100000:1.0:1788586982.746122:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500032 00000100:00100000:1.0:1788586982.746126:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500032 00000100:00100000:1.0:1788586982.746146:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788586982.746155:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127499520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746203:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127499520:12345-0@lo:400:kworker.0 Request processed in 49us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.746210:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788586982.746226:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788586982.746232:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127500032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746276:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127500032:12345-0@lo:400:kworker.0 Request processed in 45us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.746281:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1788586982.746297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788586982.746329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a19500 x1875469127499520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586982.746343:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127499520:0@lo:400:kworker.0 00010000:00080000:1.0:1788586982.746353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb4e35c00 x1875469127500032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586982.746361:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127500032:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746386:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127499264:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746412:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127499776:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746470:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746485:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127500288:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746505:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746523:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788586982.746529:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127499392:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746774:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746790:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127499904:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746810:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586982.746838:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499648 00000100:00100000:1.0:1788586982.746841:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499648 00000100:00100000:1.0:1788586982.746887:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500160 00000100:00100000:1.0:1788586982.746898:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500160 00000100:00100000:1.0:1788586982.746913:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499776 00000100:00100000:1.0:1788586982.746916:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499776 00000100:00100000:1.0:1788586982.746926:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500288 00000100:00100000:1.0:1788586982.746929:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500288 00000100:00100000:1.0:1788586982.746942:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788586982.746948:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127499648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.746987:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127499648:12345-0@lo:400:kworker.0 Request processed in 39us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.746993:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788586982.747004:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788586982.747009:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127500160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747034:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127500160:12345-0@lo:400:kworker.0 Request processed in 25us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.747038:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788586982.747046:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788586982.747051:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127499776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747081:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127499776:12345-0@lo:400:kworker.0 Request processed in 29us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.747087:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788586982.747097:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788586982.747103:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747131:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127500288:12345-0@lo:400:kworker.0 Request processed in 28us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.747136:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788586982.747156:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788586982.747159:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586982.747175:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499392 00000100:00100000:1.0:1788586982.747179:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499392 00000100:00100000:1.0:1788586982.747202:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499904 00000100:00100000:1.0:1788586982.747204:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499904 00000100:00100000:1.0:1788586982.747219:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788586982.747225:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127499392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747255:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127499392:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.747261:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788586982.747272:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788586982.747278:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127499904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747304:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127499904:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.747309:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1788586982.747322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788586982.747344:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb4e35880 x1875469127499648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586982.747355:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127499648:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747368:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127500160:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747394:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127499392:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747403:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127499904:0@lo:400:kworker.0 00010000:00080000:1.0:1788586982.747412:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb4e36300 x1875469127499776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586982.747444:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127499776:0@lo:400:kworker.0 00000100:00100000:1.0:1788586982.747467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127500288:0@lo:400:kworker.0 00000100:00100000:2.0:1788586982.747808:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127499264 00000100:00100000:2.0:1788586982.747814:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127499264 00000100:00100000:2.0:1788586982.747854:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788586982.747861:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127499264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586982.748073:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127499264:12345-0@lo:400:kworker.0 Request processed in 212us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586982.748080:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788586982.750227:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127499264:0@lo:400:kworker.0 00000100:00100000:3.0:1788586982.750672:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127499008:0@lo:400:kworker.0 00010000:00010000:0.0:1788586982.869830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586983.892846:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586984.788862:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788586984.792271:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127500416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586984.792354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586984.792460:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500416 00000100:00100000:0.0:1788586984.792468:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500416 00000100:00100000:0.0:1788586984.792542:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788586984.792554:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127500416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788586984.792588:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586984.792651:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127500416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586984.792659:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788586984.792696:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788586984.792713:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127500544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788586984.792745:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586984.792799:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500544 00000100:00100000:0.0:1788586984.792804:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500544 00000100:00100000:3.0:1788586984.792869:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127500416:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788586984.797475:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586984.797579:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586984.797592:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127500544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788586984.798463:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586984.798564:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127500544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 974us (5816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586984.798573:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788586984.799641:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127500544:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788586984.918617:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586985.068566:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586985.068642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586985.068676:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586985.068697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586985.068719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586985.068787:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637952 00000100:00100000:3.0:1788586985.068798:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637952 00000100:00100000:3.0:1788586985.068862:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638208 00000100:00100000:3.0:1788586985.068865:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638208 00000100:00100000:3.0:1788586985.068876:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637824 00000100:00100000:3.0:1788586985.068878:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637824 00000100:00100000:3.0:1788586985.068887:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638080 00000100:00100000:3.0:1788586985.068889:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638080 00000100:00100000:3.0:1788586985.068902:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 227 00000100:00100000:3.0:1788586985.068912:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637952:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586985.068979:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637952:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 69us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586985.068986:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 227 00000100:00100000:3.0:1788586985.069000:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 228 00000100:00100000:3.0:1788586985.069005:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110638208:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586985.069027:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110638208:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586985.069040:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 228 00000100:00100000:3.0:1788586985.069053:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 229 00000100:00100000:3.0:1788586985.069059:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637824:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586985.069083:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110637824:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586985.069089:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 229 00000100:00100000:3.0:1788586985.069098:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 230 00000100:00100000:3.0:1788586985.069104:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110638080:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586985.069126:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110638080:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586985.069132:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 230 00000100:00080000:0.0:1788586985.069935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586985.069942:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586985.070917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110637696 00000100:00100000:1.0:1788586985.070927:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110637696 00000100:00100000:1.0:1788586985.071007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 370 00000100:00100000:1.0:1788586985.071017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110637696:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586985.071079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110637696:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 64us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586985.071086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 370 00000100:00100000:1.0:1788586985.813583:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127500672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586985.813595:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127500800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788586985.814921:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586985.815081:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500800 00000100:00100000:0.0:1788586985.815090:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500800 00000100:00100000:0.0:1788586985.815136:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788586985.815147:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127500800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788586985.815183:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788586985.815232:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127500800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586985.815240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788586985.815604:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127500800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788586985.816713:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127500928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788586985.816771:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586985.816824:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500928 00000100:00100000:2.0:1788586985.816830:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500928 00000100:00100000:2.0:1788586985.816883:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788586985.816892:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127500928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788586985.816916:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788586985.817021:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127500928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586985.817028:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788586985.817059:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586985.817090:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcb00380 x1875469127500928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586985.817131:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127500928:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788586985.823119:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:0.0:1788586985.823127:0:9513:0:(genops.c:885:class_export_put()) final put ffff8f5bbfb26800/207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:0.0:1788586985.823166:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfb26800/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-OST0001 00000020:00000080:0.0:1788586985.823225:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfb23800 for lustre-OST0001 00000100:00100000:0.0:1788586985.824761:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586985.825162:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127500672 00000100:00100000:0.0:1788586985.825174:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127500672 00000100:00100000:0.0:1788586985.825249:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788586985.825276:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127500672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586985.825313:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586985.825371:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127500672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586985.825385:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788586985.825484:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788586985.825527:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83109c00 x1875469127500672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586985.825549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127500672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788586985.943829:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788586986.842192:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788586986.902038:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788586986.967075:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586987.351930:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586987.351954:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127501056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586987.352023:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586987.352080:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501056 00000100:00100000:2.0:1788586987.352088:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501056 00000100:00100000:2.0:1788586987.352132:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788586987.352140:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127501056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788586987.352172:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788586987.352217:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127501056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586987.352224:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788586987.352268:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127501056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788586987.879212:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127501184:0@lo:400:kworker.0 00000100:00100000:2.0:1788586987.879302:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586987.879487:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501184 00000100:00100000:1.0:1788586987.879496:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501184 00000100:00100000:1.0:1788586987.879555:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788586987.879564:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127501184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127501568:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883381:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.883460:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501568 00000100:00100000:3.0:1788586987.883467:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501568 00000100:00100000:3.0:1788586987.883522:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788586987.883531:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127501568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883589:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127501568:12345-0@lo:400:kworker.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.883596:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788586987.883647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127501568:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883687:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586987.883692:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127501696:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883726:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.883751:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501696 00000100:00100000:3.0:1788586987.883754:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501696 00000100:00100000:3.0:1788586987.883787:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788586987.883793:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127501696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883824:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127501696:12345-0@lo:400:kworker.0 Request processed in 32us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.883829:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788586987.883853:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127501696:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883895:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127502080:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.883918:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.883946:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502080 00000100:00100000:3.0:1788586987.883950:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502080 00000100:00100000:3.0:1788586987.883976:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788586987.883983:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127502080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.884017:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127502080:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586987.885286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127501184:12345-0@lo:400:kworker.0 Request processed in 5704us (5965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586987.885308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:1.0:1788586987.885761:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788586987.885767:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586987.885789:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127501440:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.885835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586987.885865:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127501952:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.885886:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586987.885908:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788586987.885914:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127501312:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.885933:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586987.885948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127501824:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.885967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586987.885995:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501952 00000100:00100000:1.0:1788586987.886001:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501952 00000100:00100000:1.0:1788586987.886053:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788586987.886060:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127501952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.886099:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127501952:12345-0@lo:400:kworker.0 Request processed in 40us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586987.886105:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788586987.886121:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501440 00000100:00100000:1.0:1788586987.886124:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501440 00000100:00100000:1.0:1788586987.886156:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501312 00000100:00100000:1.0:1788586987.886159:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501312 00000100:00100000:1.0:1788586987.886174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127501824 00000100:00100000:1.0:1788586987.886177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127501824 00000100:00100000:1.0:1788586987.886190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788586987.886196:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127501440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.886233:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127501440:12345-0@lo:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586987.886239:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788586987.886252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788586987.886257:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127501312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.886296:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127501312:12345-0@lo:400:kworker.0 Request processed in 39us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586987.886303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788586987.886314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788586987.886320:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127501824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.886345:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127501824:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586987.886351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1788586987.886365:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788586987.886368:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586987.886392:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127501312:0@lo:400:kworker.0 00010000:00080000:1.0:1788586987.886405:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83c59f80 x1875469127501824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586987.886435:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127501824:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.886446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127501440:0@lo:400:kworker.0 00010000:00080000:1.0:1788586987.886455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83c58a80 x1875469127501952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586987.886463:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127501952:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.887115:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1788586987.887235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83c5a680 x1875469127502080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586987.887246:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127502080:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.887326:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127502336:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.887357:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.887388:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502336 00000100:00100000:3.0:1788586987.887392:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502336 00000100:00100000:3.0:1788586987.887452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788586987.887458:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127502336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.887490:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127502336:12345-0@lo:400:kworker.0 Request processed in 33us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.887495:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:3.0:1788586987.887530:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83c5b480 x1875469127502336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586987.887539:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127502336:0@lo:400:kworker.0 00000100:00080000:3.0:1788586987.887552:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788586987.887577:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127502464:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.887602:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.887628:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502464 00000100:00100000:3.0:1788586987.887632:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502464 00000100:00100000:3.0:1788586987.887654:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788586987.887659:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127502464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.887688:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127502464:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.887693:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788586987.887703:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586987.887716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127502464:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.887864:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127502592:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.887890:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586987.887905:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586987.887910:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127502208:0@lo:400:kworker.0 00000100:00100000:1.0:1788586987.887927:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.887980:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502592 00000100:00100000:3.0:1788586987.887985:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502592 00000100:00100000:3.0:1788586987.888051:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788586987.888057:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127502592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.888107:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127502592:12345-0@lo:400:kworker.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.888121:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788586987.888207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502208 00000100:00100000:3.0:1788586987.888211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502208 00000100:00100000:2.0:1788586987.888282:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127501184:0@lo:400:kworker.0 00000100:00080000:1.0:1788586987.891972:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788586987.891981:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586987.895879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788586987.895893:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127502208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.895974:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127502208:12345-0@lo:400:kworker.0 Request processed in 85us (8045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.895980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788586987.896109:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127502208:0@lo:400:kworker.0 00000100:00100000:3.0:1788586987.896126:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127502592:0@lo:400:kworker.0 00010000:00010000:1.0:1788586987.988734:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586989.013837:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586989.489093:0:14057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:43:08 (1788586988) 00000100:00100000:2.0:1788586989.908898:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127502720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586989.908984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586989.909162:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502720 00000100:00100000:0.0:1788586989.909171:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502720 00000100:00100000:0.0:1788586989.909236:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788586989.909246:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127502720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788586989.909275:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586989.909322:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127502720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586989.909329:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788586989.909380:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127502720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788586989.909460:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586989.909472:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127502848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788586989.909515:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586989.909591:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502848 00000100:00100000:0.0:1788586989.909596:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502848 00000100:00100000:0.0:1788586989.909629:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788586989.909637:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127502848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788586989.909648:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586989.909679:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127502848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586989.909685:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788586989.909809:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127502848:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788586989.909868:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788586990.037371:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586990.184923:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586990.185033:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586990.185064:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586990.185103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586990.185188:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586990.185443:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638592 00000100:00100000:3.0:1788586990.185454:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638592 00000100:00100000:3.0:1788586990.185541:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638848 00000100:00100000:3.0:1788586990.185545:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638848 00000100:00100000:3.0:1788586990.185578:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638464 00000100:00100000:3.0:1788586990.185581:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638464 00000100:00100000:3.0:1788586990.185603:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638720 00000100:00100000:3.0:1788586990.185606:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638720 00000100:00100000:3.0:1788586990.185623:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 237 00000100:00100000:3.0:1788586990.185632:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110638592:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586990.185713:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110638592:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 81us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586990.185738:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 237 00000100:00100000:3.0:1788586990.185758:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 238 00000100:00100000:3.0:1788586990.185767:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110638848:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586990.185794:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110638848:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586990.185800:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 238 00000100:00100000:3.0:1788586990.185811:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 239 00000100:00100000:3.0:1788586990.185817:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110638464:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586990.185840:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110638464:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 23us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586990.185846:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 239 00000100:00100000:3.0:1788586990.185856:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 240 00000100:00100000:3.0:1788586990.185861:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110638720:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586990.185882:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110638720:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 21us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586990.185888:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 240 00000100:00100000:1.0:1788586990.188205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638336 00000100:00100000:1.0:1788586990.188221:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638336 00000100:00100000:1.0:1788586990.188858:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 372 00000100:00100000:1.0:1788586990.188870:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110638336:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788586990.189035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110638336:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 167us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586990.189043:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 372 00000100:00080000:1.0:1788586990.189155:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788586990.189160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788586990.933933:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788586990.933954:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127503104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788586990.934033:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586990.934103:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503104 00000100:00100000:0.0:1788586990.934109:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503104 00000100:00100000:0.0:1788586990.934158:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788586990.934167:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127503104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788586990.934195:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788586990.934237:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127503104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586990.934244:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1788586990.934285:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83772680 x1875469127503104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586990.934304:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83772680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127503104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586990.934512:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127502976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586990.934545:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586990.934660:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127502976 00000100:00100000:2.0:1788586990.934665:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127502976 00000100:00100000:2.0:1788586990.934715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788586990.934721:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127502976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586990.934744:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586990.934781:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127502976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586990.934787:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788586990.934815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127502976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586990.935047:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586990.935057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127503232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788586990.935087:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788586990.935112:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586990.935124:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503232 00000100:00100000:1.0:1788586990.935127:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503232 00000100:00100000:1.0:1788586990.935160:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788586990.935167:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127503232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788586990.935187:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586990.935229:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127503232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586990.935236:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788586990.935250:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788586990.935304:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbcaf7b80 x1875469127503232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586990.935318:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127503232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586991.025761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586991.025837:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110638976 00000100:00100000:3.0:1788586991.025856:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110638976 00000100:00100000:3.0:1788586991.025917:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:3.0:1788586991.025926:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+5:11073:x1875469110638976:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788586991.026045:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.026069:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107b8 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.026134:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9b5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.026149:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9b5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.026163:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9b5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586991.026289:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788586991.026294:0:13553:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788586991.026335:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9b5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.026361:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107b8 expref: 7 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.026382:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9b5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107b8 expref: 6 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.026391:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788586991.026394:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788586991.026398:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd000, rc 0) 00000100:00100000:3.0:1788586991.026581:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+6:11073:x1875469110638976:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 654us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.026588:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:0.0:1788586991.047676:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586991.047816:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110639104 00000100:00100000:3.0:1788586991.047839:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110639104 00000100:00100000:3.0:1788586991.047904:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:3.0:1788586991.047915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:11074:x1875469110639104:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788586991.047935:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.047956:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9b65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107bf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048033:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048048:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048062:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048077:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048084:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048091:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048154:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9b7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048176:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9b7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048184:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9b7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586991.048232:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788586991.048237:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788586991.048258:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9b7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048269:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048276:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048283:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048289:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecde00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586991.048293:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048312:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788586991.048326:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788586991.048330:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048347:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048363:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048369:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048375:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048380:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecca00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586991.048383:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048389:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048397:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f5b8399a100) 00010000:00010000:3.0:1788586991.048400:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788586991.048402:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048408:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9b73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048510:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9b65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107bf expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048523:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9b7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107bf expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.048536:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:3.0:1788586991.048538:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788586991.048540:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd800, rc 0) 00000100:00100000:3.0:1788586991.048617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:11074:x1875469110639104:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 704us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.048625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:0.0:1788586991.056625:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586991.056732:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110639232 00000100:00100000:3.0:1788586991.056742:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110639232 00000100:00100000:3.0:1788586991.056806:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:3.0:1788586991.056816:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:207b4310-f56a-4e63-b878-60fda37c3e93+7:11074:x1875469110639232:12345-192.168.203.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788586991.056922:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:207b4310-f56a-4e63-b878-60fda37c3e93+7:11074:x1875469110639232:12345-192.168.203.1@tcp:900:lhsmtool_posix.0 Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.056929:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00010000:00010000:1.0:1788586991.060688:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586991.063062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586991.063218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110639488 00000100:00100000:3.0:1788586991.063229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110639488 00000100:00100000:3.0:1788586991.063291:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:3.0:1788586991.063302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:11074:x1875469110639488:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788586991.063321:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586991.063340:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107c6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.063410:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.063687:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586991.063710:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074589:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074611:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074624:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074745:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd9b96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074754:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd9b96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074762:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd9b96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586991.074772:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788586991.074863:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074871:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074893:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074899:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586991.074904:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074912:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074924:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:2.0:1788586991.074927:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586991.074932:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074939:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9b88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074952:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074959:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074965:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074970:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586991.074973:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074989:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.074997:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f5b8399a100) 00010000:00010000:2.0:1788586991.074999:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586991.075002:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.075007:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9b8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.075276:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9b81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107c6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.075292:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd9b96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107c6 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586991.075300:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:2.0:1788586991.075302:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586991.075304:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050400, rc 0) 00000100:00100000:2.0:1788586991.075377:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:11074:x1875469110639488:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 12076us (12325us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788586991.075387:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:1.0:1788586991.078869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586991.079196:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110639616 00000100:00100000:3.0:1788586991.079208:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110639616 00000100:00100000:3.0:1788586991.079271:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:3.0:1788586991.079283:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+9:11074:x1875469110639616:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788586991.079391:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+9:11074:x1875469110639616:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 Request processed in 110us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.079398:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:0.0:1788586991.086940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586991.087166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110639744 00000100:00100000:3.0:1788586991.087178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110639744 00000100:00100000:3.0:1788586991.087248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:3.0:1788586991.087260:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:11074:x1875469110639744:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788586991.094660:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7344us 00000100:00100000:2.0:1788586991.109266:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:11074:x1875469110639744:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 Request processed in 21998us (22324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.109280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 44 00000040:00080000:2.0:1788586991.964311:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788586992.021905:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788586992.084713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586992.470999:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586992.471021:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127503360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788586992.471099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586992.471172:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503360 00000100:00100000:3.0:1788586992.471183:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503360 00000100:00100000:3.0:1788586992.471233:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788586992.471242:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127503360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586992.471277:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788586992.471340:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127503360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.471348:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788586992.471437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127503360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788586992.907289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586992.909216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110639872 00000100:00100000:0.0:1788586992.909231:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110639872 00000100:00100000:0.0:1788586992.909307:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:0.0:1788586992.909319:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:11116:x1875469110639872:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788586992.909349:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586992.909371:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107cd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909449:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909475:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909486:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909503:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909510:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909516:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909556:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909563:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909569:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909636:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586992.909647:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909655:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909667:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788586992.909670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586992.909675:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909682:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909695:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909701:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909707:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909712:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586992.909715:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909721:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909728:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f5baaa90500) 00010000:00010000:0.0:1788586992.909730:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586992.909740:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909746:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9bb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909778:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9ba4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107cd expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909788:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788586992.909790:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586992.909794:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107cd expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586992.909801:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788586992.909864:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:11116:x1875469110639872:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 547us (2586us total) trans 0 rc 301/301 00000100:00100000:0.0:1788586992.909872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00080000:1.0:1788586992.911381:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586992.922138:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586992.924648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110640128 00000100:00100000:0.0:1788586992.924659:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110640128 00000100:00100000:3.0:1788586992.928670:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:3.0:1788586992.928686:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:11116:x1875469110640128:12345-192.168.203.1@tcp:36:lfs.0 00010000:00010000:3.0:1788586992.928740:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586992.928769:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9b5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107b8 expref: 9 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.928786:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788586992.928859:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586992.928920:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.928934:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.928945:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.928970:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.928978:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.928986:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929774:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929786:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929794:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788586992.929809:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcc19ec0 reply state 000000002df03e77 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929820:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:3.0:1788586992.929828:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788586992.929831:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788586992.929836:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788586992.929842:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929849:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929855:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929861:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecca00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586992.929865:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929884:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929894:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788586992.929896:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788586992.929900:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929907:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bb9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788586992.929922:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcc19ec0 reply state 000000002df03e77 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929930:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586992.929936:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f5b85f9fa00) 00010000:00010000:3.0:1788586992.929938:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788586992.929940:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788586992.932311:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+10:11116:x1875469110640128:12345-192.168.203.1@tcp:36:lfs.0 Request processed in 3620us (10174us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788586992.932323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:0.0:1788586992.982774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127503616:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.982851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.982916:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127504128:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.982939:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.982959:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127504640:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.982980:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.983004:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788586992.983010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127503744:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983050:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.983068:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983091:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.983107:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127504768:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586992.983157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503616 00000100:00100000:0.0:1788586992.983164:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503616 00000100:00100000:0.0:1788586992.983204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504128 00000100:00100000:0.0:1788586992.983207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504128 00000100:00100000:0.0:1788586992.983230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504640 00000100:00100000:0.0:1788586992.983233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504640 00000100:00100000:0.0:1788586992.983245:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503744 00000100:00100000:0.0:1788586992.983248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503744 00000100:00100000:0.0:1788586992.983261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788586992.983268:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127503616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983321:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127503616:12345-0@lo:400:kworker.0 Request processed in 53us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.983328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788586992.983344:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788586992.983350:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127504128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983378:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127504128:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.983385:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788586992.983396:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788586992.983402:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127504640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983482:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127504640:12345-0@lo:400:kworker.0 Request processed in 81us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.983500:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788586992.983511:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788586992.983516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127503744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983539:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127503744:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.983545:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1788586992.983565:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788586992.983594:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127503744:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.983606:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127503616:0@lo:400:kworker.0 00010000:00080000:0.0:1788586992.983617:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83595500 x1875469127504128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586992.983626:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127504128:0@lo:400:kworker.0 00010000:00080000:0.0:1788586992.983635:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83595c00 x1875469127504640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586992.983644:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127504640:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984060:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127503872:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.984657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127504384:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984686:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.984708:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127504896:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.984765:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788586992.984771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127503488:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984798:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.984820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127504000:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984841:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.984856:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127504512:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.984874:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586992.984907:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504256 00000100:00100000:2.0:1788586992.984913:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504256 00000100:00100000:2.0:1788586992.984950:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504768 00000100:00100000:2.0:1788586992.984966:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504768 00000100:00100000:2.0:1788586992.984981:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504384 00000100:00100000:2.0:1788586992.984983:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504384 00000100:00100000:2.0:1788586992.984996:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504896 00000100:00100000:2.0:1788586992.984998:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504896 00000100:00100000:2.0:1788586992.985013:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788586992.985020:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127504256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.985066:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127504256:12345-0@lo:400:kworker.0 Request processed in 47us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.985073:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788586992.985085:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788586992.985102:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127504768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.985132:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127504768:12345-0@lo:400:kworker.0 Request processed in 31us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.985137:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788586992.985149:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788586992.985154:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.985185:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127504384:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.985191:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788586992.985201:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788586992.985206:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127504896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.985230:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127504896:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.985236:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788586992.985253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503488 00000100:00100000:2.0:1788586992.985256:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503488 00000100:00100000:2.0:1788586992.985280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788586992.985286:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127503488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.985313:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127503488:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586992.985318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788586992.985355:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127503488:0@lo:400:kworker.0 00010000:00080000:2.0:1788586992.985368:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83595180 x1875469127504384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586992.985378:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127504384:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.985393:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127504896:0@lo:400:kworker.0 00000100:00100000:3.0:1788586992.985562:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504000 00000100:00100000:3.0:1788586992.985567:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504000 00000100:00100000:3.0:1788586992.985595:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127504512 00000100:00100000:3.0:1788586992.985598:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127504512 00000100:00100000:3.0:1788586992.985618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788586992.985624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127504000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586992.985665:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127504000:12345-0@lo:400:kworker.0 Request processed in 41us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.985678:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788586992.985694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788586992.985700:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127504512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586992.985729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127504512:12345-0@lo:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586992.985735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788586992.985771:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127504000:0@lo:400:kworker.0 00000100:00100000:3.0:1788586992.985780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127504512:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.988900:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127503872 00000100:00100000:0.0:1788586992.988916:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127503872 00000100:00100000:0.0:1788586992.988984:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788586992.988993:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127503872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.989095:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127503872:12345-0@lo:400:kworker.0 Request processed in 103us (4995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586992.989102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788586992.989125:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788586992.989142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586992.989144:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788586992.989180:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83596680 x1875469127504256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586992.989195:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788586992.989207:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127504768:0@lo:400:kworker.0 00000100:00100000:2.0:1788586992.989459:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127503872:0@lo:400:kworker.0 00000100:00100000:0.0:1788586993.044506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.044659:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110640256 00000100:00100000:3.0:1788586993.044671:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110640256 00000100:00100000:3.0:1788586993.044736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:3.0:1788586993.044747:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+10:11123:x1875469110640256:12345-192.168.203.1@tcp:101:lctl.0 00010000:00010000:3.0:1788586993.044777:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586993.044801:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.044870:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9bd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.044885:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.044897:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586993.044939:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788586993.044944:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788586993.045012:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.045037:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107d4 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.045056:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107d4 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.045065:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788586993.045067:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788586993.045071:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd000, rc 0) 00000100:00100000:3.0:1788586993.045135:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83771c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+11:11123:x1875469110640256:12345-192.168.203.1@tcp:101:lctl.0 Request processed in 390us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586993.045143:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 47 00010000:00010000:1.0:1788586993.108673:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586993.117787:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.117944:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110640384 00000100:00100000:2.0:1788586993.117962:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110640384 00000100:00100000:2.0:1788586993.118021:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:2.0:1788586993.118031:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+11:11130:x1875469110640384:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586993.118052:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.118073:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9bdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107db expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118133:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118149:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118160:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118171:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118178:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118185:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118268:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fd9bf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118290:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fd9bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118298:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fd9bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586993.118332:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788586993.118336:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586993.118369:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fd9bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118379:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118385:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118391:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118397:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586993.118400:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118407:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118449:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:2.0:1788586993.118452:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586993.118456:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118487:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9be3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118500:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118506:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118511:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118516:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586993.118519:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118525:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118533:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f5b85f9fa00) 00010000:00010000:2.0:1788586993.118535:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586993.118538:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118543:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9bea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118677:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9bdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107db expref: 13 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118704:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fd9bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107db expref: 12 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.118711:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586993.118713:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788586993.118716:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050c00, rc 0) 00000100:00100000:2.0:1788586993.118809:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+12:11130:x1875469110640384:12345-192.168.203.1@tcp:101:bash.0 Request processed in 779us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.118817:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:0.0:1788586993.124690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.126124:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110640640 00000100:00100000:2.0:1788586993.126136:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110640640 00000100:00100000:2.0:1788586993.126214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:2.0:1788586993.126225:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+12:11130:x1875469110640640:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586993.126244:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.126264:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9bf8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107e2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.126646:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.126662:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.126674:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.128913:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.128950:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.128963:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788586993.130107:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788586993.130298:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130313:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130321:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130353:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130360:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130367:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130372:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586993.130377:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130394:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130436:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586993.130439:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586993.130444:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130450:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9bff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788586993.130473:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c01c149 reply state 0000000059fd5668 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130483:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130489:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:2.0:1788586993.130492:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788586993.130495:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788586993.130532:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9bf8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130547:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.130554:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:2.0:1788586993.130556:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586993.130559:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051e00, rc 0) 00000100:00100000:2.0:1788586993.130635:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+15:11130:x1875469110640640:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4411us (5956us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788586993.130644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:0.0:1788586993.136238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.136510:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110640768 00000100:00100000:2.0:1788586993.136519:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110640768 00000100:00100000:2.0:1788586993.136598:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:2.0:1788586993.136606:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1875469110640768:12345-192.168.203.1@tcp:8:bash.0 00010000:00080000:2.0:1788586993.136642:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:2.0:1788586993.136674:0:8433:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd9c1b 00002000:00100000:2.0:1788586993.136686:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 207b4310-f56a-4e63-b878-60fda37c3e93/ffff8f5a83ce7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788586993.136704:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788586993.136780:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788586993.136807:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5a83ce7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586993.136879:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110640768:12345-192.168.203.1@tcp:8:bash.0 Request processed in 272us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.136886:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:1.0:1788586993.139542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.139674:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110640896 00000100:00100000:3.0:1788586993.139685:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110640896 00000100:00100000:3.0:1788586993.139747:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:3.0:1788586993.139758:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:0:x1875469110640896:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788586993.139774:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586993.139795:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107e9 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788586993.139821:0:10047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788586993.139840:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1788586993.139844:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586993.139855:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 7 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.139906:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 7 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.139919:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecca00, rc 0) 00000100:00100000:3.0:1788586993.140110:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:0:x1875469110640896:12345-192.168.203.1@tcp:101:bash.0 Request processed in 353us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586993.140117:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00080000:0.0:1788586993.140287:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586993.143316:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.143476:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110641024 00000100:00100000:2.0:1788586993.143485:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110641024 00000100:00100000:2.0:1788586993.143539:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:2.0:1788586993.143549:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:11130:x1875469110641024:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586993.143566:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.143596:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107f0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.143626:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.143635:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586993.143639:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586993.143660:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.143697:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.143711:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586993.143725:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1875469127505024:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586993.143819:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586993.146114:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1875469127505024:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586993.146153:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.146171:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050000, rc 0) 00000100:00100000:2.0:1788586993.146228:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:11130:x1875469110641024:12345-192.168.203.1@tcp:101:bash.0 Request processed in 2680us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.146236:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:1.0:1788586993.148948:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586993.149318:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110641152 00000100:00100000:0.0:1788586993.149329:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110641152 00010000:00010000:0.0:1788586993.149372:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586993.149644:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:0.0:1788586993.149655:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110641152:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586993.149669:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586993.149692:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.149707:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.149733:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fd9c22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e9 expref: 8 pid: 10047 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.149769:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788586993.149773:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788586993.149782:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.149792:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.149830:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586993.149845:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81091500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1875469127505152:192.168.203.1@tcp:105: 00000100:00100000:0.0:1788586993.149939:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788586993.152566:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81091500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1875469127505152:192.168.203.1@tcp:105: 00010000:00010000:1.0:1788586993.152601:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586993.152659:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110641152:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 3006us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586993.152670:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:1.0:1788586993.156330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.156470:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110641408 00000100:00100000:3.0:1788586993.156480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110641408 00000100:00100000:3.0:1788586993.156542:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:3.0:1788586993.156553:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+15:11130:x1875469110641408:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:3.0:1788586993.156852:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+16:11130:x1875469110641408:12345-192.168.203.1@tcp:35:bash.0 Request processed in 299us (530us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788586993.156859:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:0.0:1788586993.240318:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586993.240457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110641664 00000100:00100000:1.0:1788586993.240481:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110641664 00000100:00100000:1.0:1788586993.240535:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:1.0:1788586993.240545:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+16:11140:x1875469110641664:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586993.240572:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586993.240592:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586993.240720:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788586993.240830:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9c30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.240845:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:1.0:1788586993.240849:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788586993.240855:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f7 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.240870:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80031a00, rc 0) 00000100:00100000:1.0:1788586993.240940:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+17:11140:x1875469110641664:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 397us (636us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1788586993.240948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:0.0:1788586993.243561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.243650:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110641920 00000100:00100000:2.0:1788586993.243659:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110641920 00000100:00100000:2.0:1788586993.243755:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:2.0:1788586993.243765:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+17:11140:x1875469110641920:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788586993.243981:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:11140:x1875469110641920:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 217us (427us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788586993.244013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:2.0:1788586993.320802:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586993.321191:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110642048 00000100:00100000:0.0:1788586993.321202:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110642048 00000100:00100000:0.0:1788586993.321275:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:0.0:1788586993.321287:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+18:11146:x1875469110642048:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788586993.321309:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586993.321332:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8107fe expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.321405:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9c45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.321496:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.321509:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586993.321565:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788586993.321569:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586993.321594:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9c45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.321622:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107fe expref: 20 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.321643:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9c45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107fe expref: 19 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.321828:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586993.321832:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788586993.321835:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5200, rc 0) 00000100:00100000:0.0:1788586993.321893:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+19:11146:x1875469110642048:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 609us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586993.321901:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:0.0:1788586993.327752:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.327838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110642304 00000100:00100000:2.0:1788586993.327848:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110642304 00000100:00100000:2.0:1788586993.327908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:2.0:1788586993.327919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+19:11146:x1875469110642304:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586993.327939:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.327958:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9c4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810805 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.328084:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9c53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.328098:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.328111:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9c53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586993.328122:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788586993.328231:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9c4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810805 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.328250:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9c53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810805 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.328258:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:2.0:1788586993.328261:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586993.328285:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050800, rc 0) 00000100:00100000:2.0:1788586993.328356:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+21:11146:x1875469110642304:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 439us (613us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788586993.328364:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:1.0:1788586993.332841:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586993.332934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.333002:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110642688 00000100:00100000:2.0:1788586993.333011:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110642688 00000100:00100000:2.0:1788586993.333073:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:2.0:1788586993.333086:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83597800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+21:2406:x1875469110642688:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586993.333102:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586993.333125:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9c53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810805 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.333154:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:2.0:1788586993.333160:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586993.333217:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83597800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+20:2406:x1875469110642688:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 133us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.333224:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:0.0:1788586993.333865:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110642560 00000100:00100000:0.0:1788586993.333872:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110642560 00000100:00100000:0.0:1788586993.333953:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:0.0:1788586993.333961:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+20:11146:x1875469110642560:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788586993.333997:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586993.334013:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9c61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81080c expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.334124:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9c68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.334151:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9c68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.334164:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9c68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586993.334177:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788586993.334292:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9c61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81080c expref: 23 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.334309:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9c68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81080c expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.334318:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:0.0:1788586993.334321:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788586993.334324:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788586993.334373:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+22:11146:x1875469110642560:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 413us (1545us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788586993.334381:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:1.0:1788586993.344956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.345025:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110642816 00000100:00100000:3.0:1788586993.345035:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110642816 00000100:00100000:3.0:1788586993.345088:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:3.0:1788586993.345098:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110642816:12345-192.168.203.1@tcp:1:lfs.0 00010000:00010000:3.0:1788586993.345137:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.345157:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.345183:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586993.345187:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788586993.345193:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.345226:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.345241:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 7 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586993.345310:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1875469127505280:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788586993.345475:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b98747a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586993.350962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.351216:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1875469127505280:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586993.351258:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586993.352034:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110642944 00000100:00100000:0.0:1788586993.352045:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110642944 00002000:00100000:0.0:1788586993.352098:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8f5a827a1500 x1875469110642944/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:309/0 lens 504/0 e 0 to 0 dl 1788587004 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788586993.352123:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a827a1500 with x1875469110642944 ext(0->12) 00010000:00010000:0.0:1788586993.352132:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 8 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.352146:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 8 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788586993.352153:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5a827a1500 00000100:00100000:0.0:1788586993.352192:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:0.0:1788586993.352201:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110642944:12345-192.168.203.1@tcp:4:lfs.0 00000001:00100000:2.0:1788586993.359761:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000100:00100000:1.0:1788586993.365706:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110642944:12345-192.168.203.1@tcp:4:lfs.0 Request processed in 13496us (14746us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788586993.365726:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00002000:00100000:1.0:1788586993.365739:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8f5a827a1500 x1875469110642944/t4294967300(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:309/0 lens 504/448 e 0 to 0 dl 1788587004 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788586993.365749:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a827a1500 with x1875469110642944 ext(0->12) 00010000:00010000:1.0:1788586993.365759:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.365799:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788586993.365807:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5a827a1500 00000100:00100000:0.0:1788586993.371610:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.371800:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110643072 00000100:00100000:2.0:1788586993.371809:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110643072 00010000:00010000:2.0:1788586993.371849:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586993.371894:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:2.0:1788586993.371904:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+9:2406:x1875469110643072:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586993.371919:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788586993.371951:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788586993.371954:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788586993 00002000:00010000:2.0:1788586993.371957:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788586993 00002000:00010000:2.0:1788586993.371959:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788586993 00002000:00010000:2.0:1788586993.371961:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788586993.371968:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.371982:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.372008:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fd9c29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107f0 expref: 9 pid: 8433 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.372024:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788586993.372029:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788586993.372035:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.372045:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.372080:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586993.372139:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+8:2406:x1875469110643072:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 236us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.372146:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00010000:00010000:3.0:1788586993.372216:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372227:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372247:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372261:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372269:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372276:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecce00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586993.372281:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372289:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372301:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.372307:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000250ff195/0xfbc93bbea5fd9c76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586993.372365:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110642816:12345-192.168.203.1@tcp:1:lfs.0 Request processed in 27268us (27421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586993.372374:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:0.0:1788586993.374913:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.374977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110643328 00000100:00100000:3.0:1788586993.374987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110643328 00000100:00100000:3.0:1788586993.375037:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:3.0:1788586993.375059:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:11146:x1875469110643328:12345-192.168.203.1@tcp:35:lfs.0 00000004:00010000:3.0:1788586993.375119:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9c68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81080c expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788586993.375315:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788586993.375375:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788586993.375841:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788586993.375885:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.375901:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.375910:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.375942:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.375956:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 26 pid: 6522 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586993.375970:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875469127505408:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788586993.376093:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83279c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586993.379476:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875469127505408:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586993.379509:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586993.379996:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.380073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110643456 00000100:00100000:2.0:1788586993.380091:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110643456 00010000:00010000:2.0:1788586993.380125:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 27 pid: 6522 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586993.380166:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:2.0:1788586993.380176:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+27:2409:x1875469110643456:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586993.380190:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586993.380197:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 27 pid: 6522 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.380210:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 27 pid: 6522 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.380231:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107e2 expref: 27 pid: 6522 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.380247:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:2.0:1788586993.380252:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.380262:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.380269:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.380291:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586993.380350:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+26:2409:x1875469110643456:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 167us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.380367:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 54 00010000:00010000:3.0:1788586993.381037:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.381055:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788586993.381184:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788586993.381325:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788586993.381494:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127505536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788586993.381550:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586993.381587:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b98747e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586993.381604:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127505536 00000100:00100000:2.0:1788586993.381611:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127505536 00000100:00100000:2.0:1788586993.381658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788586993.381667:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127505536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788586993.381753:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127505536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.381760:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788586993.382221:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127505536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788586993.382565:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788586993.382618:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127505664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788586993.382773:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586993.382803:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660000 going to sleep for 11 seconds 00000100:00100000:1.0:1788586993.382849:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127505664 00000100:00100000:1.0:1788586993.382856:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127505664 00000100:00100000:1.0:1788586993.382906:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788586993.382915:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127505664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788586993.383154:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875469127505664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 240us (495us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788586993.383162:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788586993.383165:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127505664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788586993.383217:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788586993.383251:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.383261:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.383269:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.383274:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecca00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586993.383278:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.383295:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.383309:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:3.0:1788586993.383311:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788586993.383314:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.383319:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9c7d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788586993.383411:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788586993.383727:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788586993.383739:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339314322664ns, next at 340314320104ns, rc = 0 00000001:00080000:3.0:1788586993.383746:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788586993.383769:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9600) 00010000:00010000:3.0:1788586993.383772:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788586993.383780:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9c68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81080c expref: 30 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586993.383880:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+29:11146:x1875469110643328:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 8821us (8974us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788586993.383888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 8 00000020:00080000:3.0:1788586993.383893:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788586993.386906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.387102:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110643584 00000100:00100000:2.0:1788586993.387111:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110643584 00000100:00100000:2.0:1788586993.387236:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:2.0:1788586993.387247:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+29:11146:x1875469110643584:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586993.387270:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.387289:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810813 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.387342:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810813 expref: 30 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.387358:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810813 expref: 30 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.387376:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586993.387379:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586993.387394:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051e00, rc 0) 00000100:00100000:2.0:1788586993.387485:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+30:11146:x1875469110643584:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 240us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.387505:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:0.0:1788586993.389843:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.389949:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110643840 00000100:00100000:2.0:1788586993.389957:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110643840 00000100:00100000:2.0:1788586993.390022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:2.0:1788586993.390033:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:11146:x1875469110643840:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788586993.390284:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+31:11146:x1875469110643840:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 252us (450us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788586993.390293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:3.0:1788586993.456942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586993.458573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110644096 00000100:00100000:1.0:1788586993.458588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110644096 00000100:00100000:1.0:1788586993.458671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:1.0:1788586993.458683:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+31:11156:x1875469110644096:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586993.458709:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586993.458737:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81081a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586993.458847:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788586993.458948:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9c8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81081a expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.458963:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:1.0:1788586993.458967:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788586993.458986:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81081a expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.460173:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030c00, rc 0) 00000100:00100000:1.0:1788586993.460247:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+32:11156:x1875469110644096:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1564us (3311us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788586993.460255:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:0.0:1788586993.464302:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.466321:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110644224 00000100:00100000:2.0:1788586993.466336:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110644224 00000100:00100000:0.0:1788586993.466587:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:0.0:1788586993.466600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+32:11156:x1875469110644224:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:0.0:1788586993.466737:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466754:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466765:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466794:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466802:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466808:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466897:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466903:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788586993.466949:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466961:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466967:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466974:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466980:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586993.466985:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.466999:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467011:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586993.467015:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586993.467020:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467026:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9c99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467112:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467118:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467124:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467129:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586993.467132:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467139:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467146:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:0.0:1788586993.467148:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586993.467151:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467169:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ca0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467179:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467185:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467190:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467194:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586993.467197:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467394:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467406:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586993.467408:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586993.467412:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.467456:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9ca7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586993.467554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+32:11156:x1875469110644224:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 955us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586993.467563:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:0.0:1788586993.473222:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.473311:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110644480 00000100:00100000:2.0:1788586993.473322:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110644480 00000100:00100000:2.0:1788586993.473402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:2.0:1788586993.473776:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+32:11156:x1875469110644480:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788586993.474078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+33:11156:x1875469110644480:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 664us (863us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788586993.474087:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:3.0:1788586993.508886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.509207:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110644736 00000100:00100000:2.0:1788586993.509218:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110644736 00000100:00100000:2.0:1788586993.509280:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:2.0:1788586993.509354:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+33:11159:x1875469110644736:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586993.509643:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.509665:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9cae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810821 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.509921:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.509950:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.509962:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.509975:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.509982:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.509988:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510097:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510105:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510112:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586993.510122:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788586993.510193:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510200:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510207:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510219:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586993.510223:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510231:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510244:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586993.510247:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586993.510251:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510257:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9cb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510270:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510276:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510783:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510789:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586993.510792:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510799:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510819:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:2.0:1788586993.510822:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586993.510825:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.510830:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.511010:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9cae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 36 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.511192:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 35 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.511205:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586993.511207:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586993.511209:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050a00, rc 0) 00000100:00100000:2.0:1788586993.511338:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+35:11159:x1875469110644736:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 2048us (2459us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788586993.511358:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:0.0:1788586993.514597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586993.514703:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110644864 00000100:00100000:1.0:1788586993.514714:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110644864 00000100:00100000:1.0:1788586993.514771:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:1.0:1788586993.514782:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+35:11159:x1875469110644864:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788586993.514846:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514862:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514875:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514914:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514921:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514928:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514934:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586993.514938:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514959:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514973:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586993.514976:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788586993.514981:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.514988:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9cd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586993.515063:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+35:11159:x1875469110644864:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 282us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586993.515071:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:0.0:1788586993.518385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.518484:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110645120 00000100:00100000:3.0:1788586993.518494:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110645120 00000100:00100000:3.0:1788586993.518594:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:3.0:1788586993.518617:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+35:11159:x1875469110645120:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:3.0:1788586993.518868:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+36:11159:x1875469110645120:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 253us (493us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788586993.518876:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:3.0:1788586993.740477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586993.740573:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110645376 00000100:00100000:0.0:1788586993.740584:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110645376 00000100:00100000:0.0:1788586993.740644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:0.0:1788586993.740656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+36:11190:x1875469110645376:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:0.0:1788586993.740689:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586993.740709:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9cd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810828 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.740985:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9cdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.741002:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.741015:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9cdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586993.741026:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788586993.741154:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9cd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810828 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.741175:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9cdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810828 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.741184:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586993.741187:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788586993.741206:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5800, rc 0) 00000100:00100000:0.0:1788586993.741329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+38:11190:x1875469110645376:12345-192.168.203.1@tcp:101:cat.0 Request processed in 674us (915us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788586993.741336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:1.0:1788586993.752919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586993.753168:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.753336:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110645504 00000100:00100000:2.0:1788586993.753346:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110645504 00000100:00100000:2.0:1788586993.753450:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:2.0:1788586993.753472:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+38:2406:x1875469110645504:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586993.753488:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586993.753524:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9cdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810828 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.753563:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586993.753580:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586993.753639:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+37:2406:x1875469110645504:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 180us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.753655:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:0.0:1788586993.753905:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110645760 00000100:00100000:0.0:1788586993.753910:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110645760 00000100:00100000:0.0:1788586993.753940:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00100000:0.0:1788586993.753948:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+37:11190:x1875469110645760:12345-192.168.203.1@tcp:35:cat.0 00000100:00100000:0.0:1788586993.754131:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+38:11190:x1875469110645760:12345-192.168.203.1@tcp:35:cat.0 Request processed in 183us (963us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788586993.754137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00100000:3.0:1788586993.815829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586993.815978:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110646016 00000100:00100000:2.0:1788586993.815988:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110646016 00000100:00100000:2.0:1788586993.816134:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:2.0:1788586993.816145:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+38:11196:x1875469110646016:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:2.0:1788586993.816169:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586993.816173:0:10048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788586993.816198:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9c45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107fe expref: 38 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.816217:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586993.816222:0:10048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586993.816234:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9ced lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81082f expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.816332:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.816347:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 38 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.816354:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.816753:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 38 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.816769:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 38 pid: 10048 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586993.816782:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127505792:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586993.816865:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788586993.824706:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586993.824815:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110646144 00000100:00100000:1.0:1788586993.824825:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110646144 00010000:00010000:1.0:1788586993.824875:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 39 pid: 10048 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586993.824924:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:1.0:1788586993.824935:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+39:2408:x1875469110646144:12345-192.168.203.1@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788586993.824938:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127505792:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586993.824966:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825614:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586993.825625:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 39 pid: 10048 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825639:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 39 pid: 10048 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825676:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9cc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810821 expref: 39 pid: 10048 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825692:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586993.825697:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825707:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825715:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586993.825747:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586993.825780:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.825790:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586993.825806:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+38:2408:x1875469110646144:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 872us (1107us total) trans 0 rc 0/0 00000004:00200000:2.0:1788586993.825810:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:1.0:1788586993.825815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 55 00010000:00010000:2.0:1788586993.825947:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9ced lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 39 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.825964:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 38 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586993.825973:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586993.825975:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788586993.825985:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050200, rc 0) 00000100:00100000:2.0:1788586993.826208:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+38:11196:x1875469110646016:12345-192.168.203.1@tcp:101:dd.0 Request processed in 10064us (10388us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788586993.826216:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:1.0:1788586993.830441:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586993.830731:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110646272 00000100:00100000:3.0:1788586993.830751:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110646272 00000100:00100000:3.0:1788586993.831216:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:3.0:1788586993.831228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+38:11196:x1875469110646272:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:3.0:1788586993.831252:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586993.831273:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9d02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810836 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.831311:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.831327:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.831339:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.831507:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9d02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.831527:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586993.831543:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:3.0:1788586993.831545:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788586993.831549:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecca00, rc 0) 00000100:00100000:3.0:1788586993.831614:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+39:11196:x1875469110646272:12345-192.168.203.1@tcp:101:dd.0 Request processed in 388us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586993.831621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:3.0:1788586993.834266:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586993.835323:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110646528 00000100:00100000:0.0:1788586993.835334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110646528 00000100:00100000:0.0:1788586993.835404:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 62 00000100:00100000:0.0:1788586993.835636:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+39:11196:x1875469110646528:12345-192.168.203.1@tcp:36:dd.0 00010000:00010000:0.0:1788586993.835920:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.835937:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.835948:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788586993.836305:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788586993.836334:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe0e51f4 reply state 000000006a3e5d55 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.836349:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586993.836371:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586993.836373:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788586993.836377:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788586993.838830:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+42:11196:x1875469110646528:12345-192.168.203.1@tcp:36:dd.0 Request processed in 3407us (4563us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788586993.838842:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 62 00000020:00080000:0.0:1788586993.838848:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788586994.088629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586994.088713:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110646656 00000100:00100000:0.0:1788586994.088724:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110646656 00000100:00100000:0.0:1788586994.088799:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:0.0:1788586994.088810:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+42:11210:x1875469110646656:12345-192.168.203.1@tcp:101:stat.0 00010000:00010000:0.0:1788586994.088832:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586994.088854:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81083d expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.088947:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.088963:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.088977:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.088988:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.088995:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.089014:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.089096:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.089108:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 43 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.089117:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.089150:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 43 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.089163:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 43 pid: 10048 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.089176:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127505920:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586994.089562:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf480 going to sleep for 11 seconds 00000100:00080000:2.0:1788586994.089845:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586994.091555:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127505920:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586994.091583:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586994.093522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586994.093746:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110646912 00000100:00100000:0.0:1788586994.093758:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110646912 00000100:00100000:0.0:1788586994.093837:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:0.0:1788586994.093849:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+44:6175:x1875469110646912:12345-192.168.203.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788586994.094551:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+45:6175:x1875469110646912:12345-192.168.203.1@tcp:35:ldlm_bl.0 Request processed in 702us (1036us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788586994.094559:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:3.0:1788586994.096957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586994.097572:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110647040 00000100:00100000:2.0:1788586994.097584:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110647040 00010000:00010000:2.0:1788586994.097625:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 45 pid: 10048 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586994.097717:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:2.0:1788586994.097728:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+45:2408:x1875469110647040:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586994.097745:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586994.097752:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 45 pid: 10048 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.097777:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 45 pid: 10048 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.097799:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9cf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81082f expref: 45 pid: 10048 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.097817:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586994.097822:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.097850:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.097859:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.097896:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586994.097957:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+44:2408:x1875469110647040:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 230us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586994.097964:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 56 00010000:00010000:0.0:1788586994.098706:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.098716:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586994.098782:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788586994.098787:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586994.098847:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.098861:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099094:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099103:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099109:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099115:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.099119:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099127:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099148:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586994.099151:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.099156:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099163:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099174:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099180:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099185:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099190:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.099193:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099199:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099216:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:0.0:1788586994.099219:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.099222:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099227:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099526:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81083d expref: 44 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099541:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81083d expref: 43 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.099549:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586994.099551:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788586994.099554:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5800, rc 0) 00000100:00100000:0.0:1788586994.099611:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+43:11210:x1875469110646656:12345-192.168.203.1@tcp:101:stat.0 Request processed in 10803us (10990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586994.099619:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 63 00010000:00010000:1.0:1788586994.133556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586994.190963:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.191163:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110647296 00000100:00100000:1.0:1788586994.191173:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110647296 00000100:00100000:1.0:1788586994.191309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:1.0:1788586994.191320:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+43:11216:x1875469110647296:12345-192.168.203.1@tcp:36:truncate.0 00010000:00010000:1.0:1788586994.191519:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586994.191617:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9d2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81083d expref: 43 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.191654:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586994.191660:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788586994.191912:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.191927:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.191936:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788586994.191975:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788586994.192078:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000deed6444 reply state 000000005765a4be transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.192091:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.192097:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586994.192100:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788586994.192103:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788586994.192339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+45:11216:x1875469110647296:12345-192.168.203.1@tcp:36:truncate.0 Request processed in 1020us (1384us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788586994.192347:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 64 00000020:00080000:1.0:1788586994.192352:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788586994.352406:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586994.352816:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110647424 00000100:00100000:0.0:1788586994.352827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110647424 00000100:00100000:0.0:1788586994.352888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:0.0:1788586994.352898:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+45:11230:x1875469110647424:12345-192.168.203.1@tcp:101:stat.0 00010000:00010000:0.0:1788586994.352923:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586994.352943:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810844 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353009:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353023:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353034:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353059:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353067:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353073:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353139:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353149:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353156:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586994.353197:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788586994.353201:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586994.353219:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353230:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353238:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353245:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353263:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353268:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.353273:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353280:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353292:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586994.353294:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.353299:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353305:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9d41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353319:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353325:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353330:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353335:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.353338:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353354:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353362:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:0.0:1788586994.353365:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.353368:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.353375:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9d48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.354782:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.354807:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.354815:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586994.354818:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788586994.354821:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788586994.354959:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+46:11230:x1875469110647424:12345-192.168.203.1@tcp:101:stat.0 Request processed in 2060us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586994.354968:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:3.0:1788586994.441643:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586994.441763:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110647680 00000100:00100000:0.0:1788586994.441774:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110647680 00000100:00100000:0.0:1788586994.441843:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:0.0:1788586994.441854:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+46:11240:x1875469110647680:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788586994.441876:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586994.441921:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81084b expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586994.442155:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788586994.442283:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81084b expref: 48 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.442299:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:0.0:1788586994.442302:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788586994.442309:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9d56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81084b expref: 48 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.442326:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788586994.442768:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+47:11240:x1875469110647680:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 537us (756us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788586994.442776:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:3.0:1788586994.445948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.447757:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110647936 00000100:00100000:1.0:1788586994.447772:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110647936 00000100:00100000:1.0:1788586994.447876:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:1.0:1788586994.447897:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+47:11240:x1875469110647936:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586994.448158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+48:11240:x1875469110647936:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 262us (2216us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788586994.448167:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:3.0:1788586994.506333:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.506575:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110648192 00000100:00100000:1.0:1788586994.506585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110648192 00000100:00100000:1.0:1788586994.506661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:1.0:1788586994.506672:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+48:11246:x1875469110648192:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788586994.506699:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586994.506720:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9d64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810852 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.506836:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.506853:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.506862:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.506896:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.506909:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 49 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586994.506922:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127506048:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788586994.507886:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8a627300 going to sleep for 11 seconds 00000100:00100000:3.0:1788586994.510921:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.511051:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127506048:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586994.511077:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.511200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110648320 00000100:00100000:0.0:1788586994.511208:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110648320 00010000:00010000:0.0:1788586994.511309:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 50 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.511350:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:0.0:1788586994.511359:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+50:2409:x1875469110648320:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586994.511380:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586994.511709:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 50 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.511725:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 50 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.511757:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9d4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810844 expref: 50 pid: 6522 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.511783:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586994.511788:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.511798:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.511805:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.511901:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586994.511956:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+49:2409:x1875469110648320:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 598us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586994.511964:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 57 00010000:00010000:3.0:1788586994.513733:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586994.513747:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586994.513770:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788586994.513919:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9d64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586994.513943:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586994.513971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:3.0:1788586994.513974:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788586994.513977:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030800, rc 0) 00000100:00100000:3.0:1788586994.514171:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+49:11246:x1875469110648192:12345-192.168.203.1@tcp:101:bash.0 Request processed in 7499us (7846us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788586994.514180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:0.0:1788586994.517509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.517589:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110648576 00000100:00100000:1.0:1788586994.517599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110648576 00000100:00100000:1.0:1788586994.517661:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 68 00000100:00100000:1.0:1788586994.517672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+49:11246:x1875469110648576:12345-192.168.203.1@tcp:36:bash.0 00010000:00010000:1.0:1788586994.517904:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.517921:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.517934:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788586994.517975:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788586994.518009:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085a74e66 reply state 00000000754b5ce5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.518022:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.518029:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586994.518032:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788586994.518036:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788586994.518119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+52:11246:x1875469110648576:12345-192.168.203.1@tcp:36:bash.0 Request processed in 448us (618us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788586994.518143:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 68 00000020:00080000:1.0:1788586994.518147:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788586994.524373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586994.524533:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110648704 00000100:00100000:2.0:1788586994.524542:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110648704 00000100:00100000:2.0:1788586994.524778:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:2.0:1788586994.524790:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+52:11246:x1875469110648704:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586994.524813:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586994.524832:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9d80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810859 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.524920:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.524935:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.524944:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.524978:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.525016:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 53 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586994.525030:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a827a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127506176:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586994.525147:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788586994.528743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.529320:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110648832 00000100:00100000:1.0:1788586994.529329:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110648832 00010000:00010000:1.0:1788586994.529381:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 54 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586994.529439:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:1.0:1788586994.529450:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:2408:x1875469110648832:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586994.529473:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586994.529479:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 54 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.529490:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 54 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.529511:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586994.529527:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.529539:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.529547:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.529575:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586994.529628:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:2408:x1875469110648832:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 179us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586994.529648:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 58 00010000:00010000:2.0:1788586994.530812:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9d6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810852 expref: 53 pid: 6521 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586994.530834:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a827a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127506176:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586994.530862:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.530871:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.530876:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586994.531280:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788586994.531285:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586994.531309:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.531343:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9d80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810859 expref: 53 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.531357:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810859 expref: 52 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.531528:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586994.531531:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586994.531534:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050200, rc 0) 00000100:00100000:2.0:1788586994.531604:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+52:11246:x1875469110648704:12345-192.168.203.1@tcp:101:bash.0 Request processed in 6816us (7238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586994.531612:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:0.0:1788586994.534954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.535140:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110649088 00000100:00100000:1.0:1788586994.535150:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110649088 00000100:00100000:1.0:1788586994.535206:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:1.0:1788586994.535228:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+52:11246:x1875469110649088:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:1.0:1788586994.535480:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+53:11246:x1875469110649088:12345-192.168.203.1@tcp:35:bash.0 Request processed in 265us (534us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788586994.535487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:0.0:1788586994.613339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586994.613728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110649344 00000100:00100000:3.0:1788586994.613738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110649344 00000100:00100000:3.0:1788586994.613801:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00100000:3.0:1788586994.613812:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+53:11256:x1875469110649344:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788586994.613836:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586994.613855:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9d8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810860 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586994.613952:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788586994.614171:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9d8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810860 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586994.614185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788586994.614188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788586994.614193:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9d8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810860 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586994.614208:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecde00, rc 0) 00000100:00100000:3.0:1788586994.614308:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:11256:x1875469110649344:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 498us (987us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788586994.614330:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00100000:1.0:1788586994.620320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586994.620412:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110649472 00000100:00100000:0.0:1788586994.620446:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110649472 00000100:00100000:0.0:1788586994.620512:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 71 00000100:00100000:0.0:1788586994.620529:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+54:11256:x1875469110649472:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:0.0:1788586994.620607:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620636:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620648:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620660:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620666:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620671:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620746:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620754:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620760:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788586994.620807:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620820:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620827:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620847:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620854:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.620858:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620865:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620876:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586994.620879:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.620884:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620890:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9d9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620903:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620909:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620914:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620919:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.620922:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620939:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620947:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:0.0:1788586994.620950:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.620953:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620958:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620967:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620973:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620978:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620984:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586994.620987:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620993:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.620999:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586994.621001:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586994.621004:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.621017:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9daa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.621303:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+54:11256:x1875469110649472:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 781us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586994.621310:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 71 00000100:00100000:0.0:1788586994.624719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.625192:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110649728 00000100:00100000:1.0:1788586994.625208:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110649728 00000100:00100000:1.0:1788586994.625354:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:1.0:1788586994.625365:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:11256:x1875469110649728:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586994.625644:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+55:11256:x1875469110649728:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 280us (933us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788586994.625655:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:0.0:1788586994.658335:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586994.658923:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110649984 00000100:00100000:2.0:1788586994.658933:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110649984 00000100:00100000:2.0:1788586994.658993:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:2.0:1788586994.659004:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+55:11259:x1875469110649984:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586994.659027:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586994.659047:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9db1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810867 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659119:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659135:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659147:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659159:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659167:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659192:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659324:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fd9dc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659336:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fd9dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659343:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fd9dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586994.659353:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788586994.659468:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659476:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659483:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659488:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586994.659493:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659500:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659511:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586994.659515:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586994.659526:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659533:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fd9db8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659546:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659551:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659557:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659562:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586994.659565:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659570:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659578:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:2.0:1788586994.659581:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586994.659583:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659588:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fd9dbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659624:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fd9db1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810867 expref: 58 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659650:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fd9dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810867 expref: 57 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.659656:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586994.659659:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586994.659661:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70000, rc 0) 00000100:00100000:2.0:1788586994.659730:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+57:11259:x1875469110649984:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 727us (1404us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788586994.659738:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:3.0:1788586994.662762:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586994.662804:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.663010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110650112 00000100:00100000:1.0:1788586994.663021:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110650112 00000100:00100000:1.0:1788586994.663081:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 73 00000100:00100000:1.0:1788586994.663091:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+57:11259:x1875469110650112:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788586994.663153:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.663169:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.663201:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.663217:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110650240 00000100:00100000:0.0:1788586994.663222:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110650240 00010000:00010000:1.0:1788586994.663236:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.663260:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.663261:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 5 00010000:00010000:1.0:1788586994.663267:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586994.663268:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+58:2407:x1875469110650240:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586994.663273:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586994.663278:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.663278:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586994.663284:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.663293:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fd9dc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810867 expref: 58 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.663295:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586994.663297:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788586994.663302:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.663307:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.663307:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586994.663319:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586994.663366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+57:2407:x1875469110650240:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 98us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586994.663373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:1.0:1788586994.665596:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+56:11259:x1875469110650112:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 2495us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586994.665609:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 73 00000100:00100000:0.0:1788586994.672202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.672332:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110650496 00000100:00100000:1.0:1788586994.672354:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110650496 00000100:00100000:1.0:1788586994.672411:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:1.0:1788586994.672463:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+56:11259:x1875469110650496:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586994.672683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+57:11259:x1875469110650496:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 230us (493us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788586994.672692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:2.0:1788586994.839036:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586994.839386:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110650752 00000100:00100000:0.0:1788586994.839397:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110650752 00000100:00100000:0.0:1788586994.839512:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 74 00000100:00100000:0.0:1788586994.839522:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+57:11277:x1875469110650752:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:0.0:1788586994.839561:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586994.839582:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ddb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81086e expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.839692:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9de2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.839708:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9de2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.839720:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9de2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586994.839730:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788586994.839846:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9ddb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81086e expref: 60 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.839864:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9de2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81086e expref: 59 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586994.839872:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586994.839875:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788586994.839878:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788586994.839944:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+59:11277:x1875469110650752:12345-192.168.203.1@tcp:101:cat.0 Request processed in 423us (919us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788586994.839951:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 74 00000100:00100000:3.0:1788586994.898325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.899368:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110650880 00000100:00100000:1.0:1788586994.899380:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110650880 00000100:00100000:1.0:1788586994.899486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 75 00000100:00100000:1.0:1788586994.899497:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+59:11278:x1875469110650880:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586994.899523:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586994.899545:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9df0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810875 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.899620:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9df7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.899637:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9df7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.899660:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9df7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586994.899702:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788586994.899706:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788586994.899725:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9df7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.899751:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9df0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810875 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.899792:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9df7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810875 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.899801:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586994.899871:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788586994.899876:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b80030800, rc 0) 00000100:00100000:1.0:1788586994.899996:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+60:11278:x1875469110650880:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 500us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586994.900004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 75 00000100:00100000:3.0:1788586994.912891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.912984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110651264 00000100:00100000:1.0:1788586994.912995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110651264 00000100:00100000:1.0:1788586994.913059:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:1.0:1788586994.913069:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+60:11278:x1875469110651264:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586994.913353:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+61:11278:x1875469110651264:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 284us (470us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788586994.913360:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:2.0:1788586994.921021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.922234:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110651392 00000100:00100000:1.0:1788586994.922247:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110651392 00000100:00100000:1.0:1788586994.922389:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:1.0:1788586994.922401:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:11278:x1875469110651392:12345-192.168.203.1@tcp:103:lfs.0 00010000:00010000:1.0:1788586994.922462:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788586994.922489:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fd9d87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810859 expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.922517:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9de2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81086e expref: 60 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.922550:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051e00/0xfbc93bbea5fd9c84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810813 expref: 59 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.922562:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586994.922567:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586994.922638:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:11278:x1875469110651392:12345-192.168.203.1@tcp:103:lfs.0 Request processed in 240us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586994.922657:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:3.0:1788586994.928796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586994.928889:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110651520 00000100:00100000:1.0:1788586994.928900:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110651520 00000100:00100000:1.0:1788586994.928966:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 76 00000100:00100000:1.0:1788586994.928977:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:11278:x1875469110651520:12345-192.168.203.1@tcp:58:lfs.0 00010000:00010000:1.0:1788586994.929110:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.929132:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586994.929145:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788586994.930571:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586994.930863:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788586994.930963:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788586994.931063:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:11278:x1875469110651520:12345-192.168.203.1@tcp:58:lfs.0 Request processed in 2084us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586994.931074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 76 00000100:00100000:3.0:1788586994.978935:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586994.979048:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110651648 00000100:00100000:2.0:1788586994.979057:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110651648 00000100:00100000:2.0:1788586994.979125:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:2.0:1788586994.979136:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+58:11280:x1875469110651648:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586994.979154:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586994.979174:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9e05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81087c expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979236:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979252:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979263:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979293:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979301:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979308:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979380:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979389:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979396:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586994.979491:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788586994.979496:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586994.979515:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979527:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979534:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979540:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979558:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979935:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586994.979941:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979949:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979961:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586994.979965:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586994.979969:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979976:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fd9e0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979990:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.979995:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980001:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980005:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586994.980009:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980025:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980034:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:2.0:1788586994.980037:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586994.980040:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980045:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980074:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9e05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 60 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980088:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 59 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586994.980095:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586994.980097:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788586994.980099:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70400, rc 0) 00000100:00100000:2.0:1788586994.980218:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+59:11280:x1875469110651648:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1083us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586994.980227:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:2.0:1788586995.028872:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586995.028897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127506304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788586995.028970:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788586995.029247:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788586995.029252:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788586995.029294:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788586995.029306:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788586995.029448:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127506432:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788586995.029521:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9869a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586995.029735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586995.029769:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586995.030243:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127506304 00000100:00100000:3.0:1788586995.030253:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127506304 00000100:00100000:3.0:1788586995.030354:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127506560 00000100:00100000:3.0:1788586995.030358:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127506560 00000100:00080000:2.0:1788586995.030726:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788586995.031332:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788586995.031351:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127506304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788586995.031388:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586995.031813:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127506304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 470us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.031821:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788586995.031848:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586995.031856:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127506560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586995.031869:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788586995.031905:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127506560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.031910:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586995.031954:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127506560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788586995.032098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127506304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788586995.039153:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.039256:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127506432:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788586995.039443:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110651776 00000100:00100000:3.0:1788586995.039461:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110651776 00000100:00100000:3.0:1788586995.039516:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:3.0:1788586995.039527:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+59:11287:x1875469110651776:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788586995.039556:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788586995.039675:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+59:11287:x1875469110651776:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 149us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.039683:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:0.0:1788586995.045086:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.045628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110651904 00000100:00100000:1.0:1788586995.045638:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110651904 00000100:00100000:1.0:1788586995.045702:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 79 00000100:00100000:1.0:1788586995.045712:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+59:11287:x1875469110651904:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788586995.045782:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045800:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045812:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045855:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045864:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045871:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045899:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045909:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045916:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586995.045966:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788586995.045970:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788586995.045985:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.045996:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046002:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046009:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046028:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.046033:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046040:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046051:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:1.0:1788586995.046054:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.046060:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046066:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031a00/0xfbc93bbea5fd9e21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046082:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046088:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046094:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046098:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.046101:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046107:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046126:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8f5a83482100) 00010000:00010000:1.0:1788586995.046128:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.046132:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046137:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046151:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046157:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046168:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.046170:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046176:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046183:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:1.0:1788586995.046185:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.046188:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.046194:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586995.046510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbdbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+59:11287:x1875469110651904:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 Request processed in 797us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.046528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 79 00000100:00100000:1.0:1788586995.053237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.053342:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110652160 00000100:00100000:2.0:1788586995.053353:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110652160 00000100:00100000:2.0:1788586995.053471:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 80 00000100:00100000:2.0:1788586995.053557:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+59:11287:x1875469110652160:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586995.053578:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586995.053599:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9e36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810883 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053732:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053748:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053758:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586995.053769:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788586995.053844:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053851:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053858:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053864:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586995.053868:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053886:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053899:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586995.053902:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788586995.053908:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.053984:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9e3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.054026:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9e36 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810883 expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.054037:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:2.0:1788586995.054039:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788586995.054042:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9e36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810883 expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.054051:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70200, rc 0) 00000100:00100000:2.0:1788586995.054112:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+60:11287:x1875469110652160:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 558us (883us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788586995.058609:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 80 00000100:00100000:3.0:1788586995.063823:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.064011:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110652288 00000100:00100000:0.0:1788586995.064026:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110652288 00000100:00100000:0.0:1788586995.064146:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:0.0:1788586995.064156:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+60:11287:x1875469110652288:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788586995.064216:0:13553:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788586995.064346:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+60:11287:x1875469110652288:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 191us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.064354:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:0.0:1788586995.069819:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.069980:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110652544 00000100:00100000:1.0:1788586995.069991:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110652544 00000100:00100000:1.0:1788586995.070063:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 82 00000100:00100000:1.0:1788586995.070074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+60:11287:x1875469110652544:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788586995.070094:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.070097:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788586995.070124:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030800/0xfbc93bbea5fd9df7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810875 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.070143:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586995.070148:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788586995.070161:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81088a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788586995.070893:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788586995.071051:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.071077:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.071089:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.071159:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fd9e4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81088a expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.071175:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81088a expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.071182:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482100) 00010000:00010000:1.0:1788586995.071185:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788586995.071188:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467c00, rc 0) 00000100:00100000:1.0:1788586995.071295:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:11287:x1875469110652544:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 1223us (1487us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788586995.071303:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 82 00000100:00100000:2.0:1788586995.080780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.080867:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110652800 00000100:00100000:0.0:1788586995.080877:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110652800 00000100:00100000:0.0:1788586995.080953:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 83 00000100:00100000:0.0:1788586995.080963:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+61:11287:x1875469110652800:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788586995.081024:0:10048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586995.081061:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fd9e52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81088a expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081081:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482100) 00010000:00010000:0.0:1788586995.081091:0:10048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586995.081115:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081145:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081156:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081175:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081183:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081189:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081239:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081246:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081253:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081260:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.081264:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081274:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081283:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586995.081295:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.081300:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081306:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9e60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081316:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081321:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081327:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081332:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.081335:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081341:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081349:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc849689e (ffff8f5baaa90300) 00010000:00010000:0.0:1788586995.081351:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.081354:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.081359:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc849689e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586995.081488:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+60:11287:x1875469110652800:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 526us (716us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586995.081502:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 83 00000100:00100000:3.0:1788586995.085495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.085578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110652928 00000100:00100000:1.0:1788586995.085588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110652928 00000100:00100000:1.0:1788586995.085640:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 84 00000100:00100000:1.0:1788586995.085656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+60:11287:x1875469110652928:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788586995.085677:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.085701:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fd9e6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810891 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.085736:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.085749:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.085761:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.085894:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fd9e6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.085914:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.085923:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:1.0:1788586995.085926:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788586995.085930:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466a00, rc 0) 00000100:00100000:1.0:1788586995.085994:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+61:11287:x1875469110652928:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 340us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.086001:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 84 00000100:00100000:1.0:1788586995.089716:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.091475:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110653184 00000100:00100000:0.0:1788586995.091493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110653184 00000100:00100000:0.0:1788586995.091569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 85 00000100:00100000:0.0:1788586995.091580:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:11287:x1875469110653184:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788586995.091668:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.091686:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.091698:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788586995.092410:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788586995.092443:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341023026687ns, next at 342023023537ns, rc = 0 00000004:00010000:0.0:1788586995.092509:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002447b716 reply state 000000003ce4f16f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.092524:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.092532:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:0.0:1788586995.092535:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788586995.092540:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788586995.092647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+63:11287:x1875469110653184:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 1067us (2938us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788586995.092655:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 85 00000100:00100000:1.0:1788586995.103039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.103467:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110653312 00000100:00100000:0.0:1788586995.103490:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110653312 00000100:00100000:0.0:1788586995.103552:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 86 00000100:00100000:0.0:1788586995.103563:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+63:11287:x1875469110653312:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788586995.103587:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586995.103607:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810898 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.103666:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 64 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.103680:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 64 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.103698:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:0.0:1788586995.103795:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788586995.103800:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788586995.103868:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+64:11287:x1875469110653312:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 305us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.103875:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 86 00000100:00100000:0.0:1788586995.108401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.108624:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110653440 00000100:00100000:3.0:1788586995.108635:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110653440 00000100:00100000:3.0:1788586995.108684:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:3.0:1788586995.108693:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1875469110653440:12345-192.168.203.1@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788586995.108727:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:3.0:1788586995.108767:0:8436:0:(genops.c:1385:class_connect()) connect: client 207b4310-f56a-4e63-b878-60fda37c3e93, cookie 0xfbc93bbea5fd9e8a 00002000:00100000:3.0:1788586995.108782:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 207b4310-f56a-4e63-b878-60fda37c3e93/ffff8f5a83eb5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788586995.108794:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788586995.108873:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788586995.108903:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8f5a83eb3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586995.109368:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2405:x1875469110653440:12345-192.168.203.1@tcp:8:lhsmtool_posix.0 Request processed in 673us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.109378:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:3.0:1788586995.114766:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.114924:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110653568 00000100:00100000:0.0:1788586995.114937:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110653568 00000100:00080000:1.0:1788586995.115081:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788586995.115303:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:0.0:1788586995.115315:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:0:x1875469110653568:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1788586995.117270:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1788586995.117281:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000100:00100000:1.0:1788586995.117506:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:0:x1875469110653568:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 2190us (2749us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788586995.117517:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:1.0:1788586995.121069:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.121151:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110653824 00000100:00100000:0.0:1788586995.121168:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110653824 00000100:00100000:0.0:1788586995.121229:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:0.0:1788586995.121239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+64:11287:x1875469110653824:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788586995.121502:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+65:11287:x1875469110653824:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 263us (438us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788586995.121511:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:0.0:1788586995.123904:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.124053:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654080 00000100:00100000:3.0:1788586995.124063:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654080 00000100:00100000:3.0:1788586995.124126:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 87 00000100:00100000:3.0:1788586995.124137:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+65:11287:x1875469110654080:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788586995.124266:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+65:11287:x1875469110654080:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 131us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.124273:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 87 00000100:00100000:3.0:1788586995.129481:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.129862:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654208 00000100:00100000:0.0:1788586995.129871:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654208 00000100:00100000:0.0:1788586995.129941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 88 00000100:00100000:0.0:1788586995.129952:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+65:11287:x1875469110654208:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788586995.129974:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586995.129996:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9e91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81089f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.130088:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9e98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.130103:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.130115:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586995.130165:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586995.130186:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.130211:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fd9e91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81089f expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.130235:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81089f expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.130245:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:0.0:1788586995.130249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788586995.130252:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788586995.130323:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+66:11287:x1875469110654208:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 373us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.130331:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 88 00000100:00100000:0.0:1788586995.135039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.135238:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654336 00000100:00100000:2.0:1788586995.135251:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654336 00000100:00100000:2.0:1788586995.135346:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:2.0:1788586995.135357:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110654336:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586995.135386:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586995.135406:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108a6 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788586995.135541:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9babf3, blocks: 0x0 00010000:00010000:2.0:1788586995.135561:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1788586995.135566:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586995.135577:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.135596:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.135606:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71e00, rc 0) 00000100:00100000:2.0:1788586995.135927:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110654336:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 571us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.135935:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:0.0:1788586995.148472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.148577:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654592 00000100:00100000:2.0:1788586995.148588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654592 00000100:00100000:2.0:1788586995.148836:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 89 00000100:00100000:2.0:1788586995.148847:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+66:11287:x1875469110654592:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788586995.148956:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+66:11287:x1875469110654592:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.148964:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 89 00000100:00100000:0.0:1788586995.154807:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.154875:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654720 00000100:00100000:2.0:1788586995.154893:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654720 00000100:00100000:2.0:1788586995.154961:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:2.0:1788586995.154973:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:11287:x1875469110654720:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586995.154993:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586995.155023:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108ad expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.155072:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.155083:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586995.155088:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586995.155095:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.155131:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.155145:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 7 pid: 8433 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.155159:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a834a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1875469127506688:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586995.155275:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a240 going to sleep for 11 seconds 00010000:00010000:3.0:1788586995.157910:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586995.158072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.158150:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654848 00000100:00100000:2.0:1788586995.158152:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a834a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1875469127506688:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788586995.158159:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654848 00010000:00010000:2.0:1788586995.158193:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.158205:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 8 pid: 8433 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.158252:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71a00, rc 0) 00000100:00100000:3.0:1788586995.158254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:3.0:1788586995.158268:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110654848:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586995.158295:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788586995.158312:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:11287:x1875469110654720:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 3340us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.158321:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 35 00010000:00010000:3.0:1788586995.158363:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 7 pid: 8433 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.158384:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 7 pid: 8433 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.158411:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fd9e9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108a6 expref: 7 pid: 8433 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.158441:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586995.158446:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586995.158466:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.158477:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.158510:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.158564:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1875469127506816:192.168.203.1@tcp:105: 00000100:00100000:3.0:1788586995.158629:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586995.166335:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1875469127506816:192.168.203.1@tcp:105: 00010000:00010000:3.0:1788586995.166365:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586995.166463:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110654848:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 8197us (8405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.166474:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:0.0:1788586995.168735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.168927:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110654976 00000100:00100000:3.0:1788586995.168937:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110654976 00002000:00100000:3.0:1788586995.168984:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f5a83666300 x1875469110654976/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:311/0 lens 504/0 e 0 to 0 dl 1788587006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788586995.168995:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83666300 with x1875469110654976 ext(0->8) 00002000:00010000:3.0:1788586995.169000:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83666300 00000100:00100000:3.0:1788586995.171543:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:3.0:1788586995.171568:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110654976:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788586995.173528:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110654976:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 Request processed in 1951us (4785us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788586995.173542:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00002000:00100000:3.0:1788586995.173553:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f5a83666300 x1875469110654976/t4294967303(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:311/0 lens 504/448 e 0 to 0 dl 1788587006 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788586995.173565:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83666300 with x1875469110654976 ext(0->8) 00002000:00010000:3.0:1788586995.173571:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83666300 00000100:00100000:0.0:1788586995.177524:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.178644:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110655104 00000100:00100000:2.0:1788586995.178656:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110655104 00000100:00100000:2.0:1788586995.178713:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 90 00000100:00100000:2.0:1788586995.178723:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+66:11287:x1875469110655104:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788586995.182492:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788586995.182510:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788586995.182578:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788586995.182594:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5b98747a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788586995.182599:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5bbfa6d200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5b98747e40 00000020:00080000:3.0:1788586995.182603:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5bbfa6de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5a8363da00 00000100:00100000:3.0:1788586995.182736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127506944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788586995.182828:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586995.182971:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+20:11287:x1875469110655104:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 Request processed in 4246us (5453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.182981:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 90 00000100:00100000:3.0:1788586995.183013:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127506944 00000100:00100000:3.0:1788586995.183020:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127506944 00000100:00100000:3.0:1788586995.183066:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586995.183075:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127506944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788586995.183097:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788586995.183125:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9babf1, atime: 0x6a9babf1, ctime: 0x6a9babf1, blocks: 0x8 00010000:00010000:3.0:1788586995.183133:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.183148:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788586995.183152:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586995.183158:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.183175:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.183185:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.183193:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.183220:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788586995.183352:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875469127506944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 278us (524us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788586995.183360:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:3.0:1788586995.183400:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a83606680/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788586995.183406:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127506944:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788586995.183565:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183574:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183581:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183587:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.183591:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183619:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183634:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f5b85f9fa00) 00010000:00010000:0.0:1788586995.183636:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.183641:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183648:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fd9bc0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183666:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183671:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183677:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183681:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.183683:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183688:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183695:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586995.183697:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.183701:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183714:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9bc7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183728:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183734:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183739:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183743:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.183746:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183751:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183769:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834b9500) 00010000:00010000:0.0:1788586995.183772:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.183775:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183781:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051a00/0xfbc93bbea5fd9c06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183797:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183803:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183814:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183819:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.183822:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183827:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183836:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586995.183838:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.183840:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183846:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9d10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183858:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183864:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183870:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183875:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.183877:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183893:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183901:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586995.183903:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.183906:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183911:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030200/0xfbc93bbea5fd9d33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183923:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183929:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183934:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183939:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.183942:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183949:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183956:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586995.183957:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586995.183960:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183976:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80030c00/0xfbc93bbea5fd9d79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183989:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.183995:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.184000:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.184005:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586995.184007:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.184012:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.184020:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:0.0:1788586995.184022:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788586995.184025:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.184031:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9e7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788586995.185491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788586995.185505:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586995.185515:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.185528:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecde00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788586995.185532:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.185551:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.185650:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788586995.185670:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127507072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788586995.185730:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586995.185912:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127507072 00000100:00100000:0.0:1788586995.185922:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127507072 00000100:00100000:0.0:1788586995.185965:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586995.185974:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127507072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788586995.186101:0:10047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788586995.186104:0:10047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788586995 00002000:00010000:0.0:1788586995.186106:0:10047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788586995.186108:0:10047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788586995 -> 1788586995 00002000:00010000:0.0:1788586995.186111:0:10047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788586995.186166:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127507072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (436us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788586995.186174:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788586995.186225:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a82294700/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788586995.186232:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127507072:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788586995.186344:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.186354:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002feeaa3a/0xfbc93bbea5fd9ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.186378:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586995.186380:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586995.186382:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788586995.186974:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788586995.187136:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788586995.189215:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.189324:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110655232 00000100:00100000:3.0:1788586995.189334:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110655232 00000100:00100000:3.0:1788586995.189389:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:3.0:1788586995.189399:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110655232:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788586995.192006:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788586995.192021:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788586995.192175:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110655232:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 Request processed in 2773us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.192186:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:1.0:1788586995.207637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.209536:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110655488 00000100:00100000:2.0:1788586995.209547:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110655488 00000100:00100000:2.0:1788586995.209729:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 91 00000100:00100000:2.0:1788586995.209740:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+14:11287:x1875469110655488:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788586995.209802:0:13553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586995.209830:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9e98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81089f expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.209847:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:2.0:1788586995.209853:0:13553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586995.209881:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.209896:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.209919:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788586995.210037:0:13553:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b20401df reply state 00000000b1467247 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.210050:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.210057:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:2.0:1788586995.210060:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788586995.210063:0:13553:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788586995.210164:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+15:11287:x1875469110655488:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 426us (2799us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788586995.210172:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 91 00000100:00100000:2.0:1788586995.215391:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.215673:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110655616 00000100:00100000:3.0:1788586995.215684:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110655616 00000100:00100000:3.0:1788586995.215738:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:3.0:1788586995.215748:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110655616:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788586995.216459:0:10047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788586995.216464:0:10047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788586995 -> 1788586994 00002000:00010000:3.0:1788586995.216467:0:10047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788586993 00002000:00010000:3.0:1788586995.216469:0:10047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788586995 -> 1788586994 00002000:00010000:3.0:1788586995.216471:0:10047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788586995.216538:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110655616:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 790us (1154us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788586995.216630:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:2.0:1788586995.219620:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.219659:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110655872 00000100:00100000:2.0:1788586995.219669:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110655872 00000100:00100000:2.0:1788586995.219721:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 92 00000100:00100000:2.0:1788586995.219731:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+15:11287:x1875469110655872:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788586995.219923:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.219941:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.219952:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.220011:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.220026:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 15 pid: 6522 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.220040:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127507200:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586995.220137:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788586995.232857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.232941:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656000 00000100:00100000:0.0:1788586995.232950:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656000 00010000:00010000:0.0:1788586995.232991:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 16 pid: 6522 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586995.233033:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:0.0:1788586995.233043:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:2409:x1875469110656000:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586995.233058:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586995.233065:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 16 pid: 6522 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.233077:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 16 pid: 6522 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.233098:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:0.0:1788586995.233116:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.233126:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.233133:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.233154:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586995.233218:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:2409:x1875469110656000:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 176us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.233225:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 60 00010000:00010000:3.0:1788586995.233354:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fd9e75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810891 expref: 15 pid: 6522 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.233371:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127507200:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586995.233393:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233403:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233408:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233507:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233515:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233522:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233527:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586995.233531:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233539:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233559:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:3.0:1788586995.233562:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788586995.233565:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.233571:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fd9ebb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.233612:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+14:11287:x1875469110655872:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 Request processed in 13882us (14001us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788586995.233620:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 92 00000100:00100000:2.0:1788586995.236591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.237070:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656128 00000100:00100000:3.0:1788586995.237081:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656128 00000100:00100000:3.0:1788586995.237773:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:3.0:1788586995.237789:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110656128:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788586995.237837:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.237858:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.237867:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586995.237871:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788586995.237876:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.237913:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.237942:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 7 pid: 8434 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.237958:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127507328:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788586995.238051:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586995.243951:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127507328:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586995.243983:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.248782:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.248875:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656256 00000100:00100000:0.0:1788586995.248885:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656256 00010000:00010000:0.0:1788586995.248924:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 8 pid: 8434 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586995.248960:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:0.0:1788586995.248969:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110656256:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586995.248983:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586995.249005:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 8 pid: 8434 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.249019:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 8 pid: 8434 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.249044:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fd9ea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ad expref: 8 pid: 8434 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.249078:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788586995.249083:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788586995.249090:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.249101:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.249147:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586995.249217:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110656256:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 248us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.249225:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 61 00010000:00010000:2.0:1788586995.249467:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249478:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249499:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249508:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249516:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249540:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecce00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788586995.249544:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249554:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249567:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.249575:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000250ff195/0xfbc93bbea5fd9ec2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.249625:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110656128:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 Request processed in 11841us (13042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.249632:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:2.0:1788586995.255954:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.256033:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656512 00000100:00100000:3.0:1788586995.256043:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656512 00000100:00100000:3.0:1788586995.256103:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 93 00000100:00100000:3.0:1788586995.256113:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:11287:x1875469110656512:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788586995.256194:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.256221:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.256232:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.256268:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.256301:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 14 pid: 6521 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.256317:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127507456:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788586995.256411:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586995.258699:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83605f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127507456:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586995.258732:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.262543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.263528:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656640 00000100:00100000:0.0:1788586995.263538:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656640 00010000:00010000:0.0:1788586995.263581:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 15 pid: 6521 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586995.263627:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 62 00000100:00100000:0.0:1788586995.263636:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+15:2409:x1875469110656640:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586995.263652:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586995.263659:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 15 pid: 6521 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.263673:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 15 pid: 6521 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.263715:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9d09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810836 expref: 15 pid: 6521 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.263733:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:0.0:1788586995.263739:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.263760:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.263767:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.263855:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586995.263918:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:2409:x1875469110656640:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 282us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.263926:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 62 00010000:00010000:3.0:1788586995.264692:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.264703:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.264932:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.264947:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 14 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.264956:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.265005:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 14 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.265018:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 14 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.265033:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127507584:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586995.265142:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788586995.266619:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127507584:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586995.266639:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.267110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.267276:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656768 00000100:00100000:0.0:1788586995.267284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656768 00010000:00010000:0.0:1788586995.267317:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 15 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586995.267354:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:0.0:1788586995.267363:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+15:2409:x1875469110656768:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586995.267385:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586995.267393:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 15 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.267405:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 15 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.267470:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9e83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810898 expref: 15 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.267485:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:0.0:1788586995.267490:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.267499:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.267506:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.267534:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586995.267578:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+14:2409:x1875469110656768:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 215us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.267586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 63 00010000:00010000:2.0:1788586995.268034:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.268043:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788586995.268146:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788586995.268265:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788586995.268301:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788586995.268380:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836df100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127507712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788586995.268469:0:10048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586995.268498:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586995.268721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127507712 00000100:00100000:3.0:1788586995.268729:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127507712 00000100:00100000:3.0:1788586995.268927:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788586995.268937:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10048:x1875469127507712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788586995.269119:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10048:x1875469127507712:12345-0@lo:1000:mdt00_003.0 Request processed in 183us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.269128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788586995.269298:0:10048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788586995.269304:0:10048:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a82294700, transno 4294967304 00000100:00100000:0.0:1788586995.269322:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836df100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127507712:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788586995.269606:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788586995.269674:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127507840:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788586995.269713:0:10048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586995.269737:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef240 going to sleep for 11 seconds 00000100:00100000:1.0:1788586995.269772:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127507840 00000100:00100000:1.0:1788586995.269778:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127507840 00000100:00100000:1.0:1788586995.269813:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788586995.269820:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10048:x1875469127507840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788586995.269937:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10048:x1875469127507840:12345-0@lo:1000:mdt00_003.0 Request processed in 117us (223us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788586995.269943:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788586995.270068:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127507840:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788586995.270104:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270114:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270133:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270139:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586995.270143:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270152:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270166:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:2.0:1788586995.270169:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586995.270173:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270180:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ed0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270209:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270216:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270221:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270226:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586995.270229:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270245:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270255:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586995.270257:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586995.270261:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270266:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b80031800/0xfbc93bbea5fd9dfe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270290:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270304:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 17 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270314:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270339:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 17 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.270353:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 17 pid: 10048 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.270364:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127507968:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586995.270463:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788586995.275997:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836df480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127507968:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586995.276013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00010000:00010000:0.0:1788586995.276029:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.276292:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110656896 00000100:00100000:3.0:1788586995.276299:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110656896 00010000:00010000:3.0:1788586995.276334:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 18 pid: 10048 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.276404:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:3.0:1788586995.276435:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+18:2408:x1875469110656896:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586995.276462:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586995.276470:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 18 pid: 10048 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.276483:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 18 pid: 10048 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.276504:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fd9e1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81087c expref: 18 pid: 10048 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.276522:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:3.0:1788586995.276527:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.276537:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.276545:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.276574:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586995.276621:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.276624:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+17:2408:x1875469110656896:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 210us (610us total) trans 0 rc 0/0 00010000:00010000:2.0:1788586995.276638:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.276643:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 64 00010000:00010000:2.0:1788586995.276657:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276666:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276673:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276752:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586995.276757:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276765:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276776:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586995.276779:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586995.276783:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276789:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9ed7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276800:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276817:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276824:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276830:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586995.276833:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276840:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276849:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a834b9a00) 00010000:00010000:2.0:1788586995.276852:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788586995.276854:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.276860:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fd9ec9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.277004:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:11287:x1875469110656512:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 20891us (21057us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788586995.277013:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 93 00000020:00080000:2.0:1788586995.277017:0:10048:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788586995.279575:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586995.279589:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788586995.279612:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788586995.279621:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788586995.282024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.282113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657152 00000100:00100000:0.0:1788586995.282122:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657152 00000100:00100000:0.0:1788586995.282163:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:0.0:1788586995.282170:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+16:11287:x1875469110657152:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788586995.282481:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788586995.282512:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788586995.282546:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.282563:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.282586:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.282603:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.282936:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.282945:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.282984:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788586995.283106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+18:11287:x1875469110657152:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 933us (1275us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788586995.283114:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000020:00080000:0.0:1788586995.283118:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788586995.283978:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586995.283988:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.283995:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586995.283999:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.284008:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.284024:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:3.0:1788586995.284027:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788586995.284032:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.284038:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9ede lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.284054:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586995.284057:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586995.284060:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586995.303199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.303321:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.303357:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.303404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.303553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657280 00000100:00100000:2.0:1788586995.303904:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657664 00000100:00100000:2.0:1788586995.303911:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657664 00000100:00100000:2.0:1788586995.303981:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00100000:0.0:1788586995.304015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657408 00000100:00100000:0.0:1788586995.304022:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657408 00000100:00100000:0.0:1788586995.304067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657920 00000100:00100000:0.0:1788586995.304071:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657920 00000100:00100000:0.0:1788586995.304096:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 247 00000100:00100000:0.0:1788586995.304104:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110657408:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586995.304182:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110657408:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 79us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.304190:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 247 00000100:00100000:0.0:1788586995.304207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 248 00000100:00100000:0.0:1788586995.304213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110657920:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586995.304238:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110657920:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.304244:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 248 00000100:00100000:2.0:1788586995.304668:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110657664:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586995.304707:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110657664:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 716us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.304715:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00080000:2.0:1788586995.304735:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586995.304739:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586995.305781:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657280 00000100:00100000:3.0:1788586995.305853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 374 00000100:00100000:3.0:1788586995.305863:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110657280:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586995.305907:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110657280:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 45us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.305931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 374 00000100:00100000:0.0:1788586995.313831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.313898:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657536 00000100:00100000:1.0:1788586995.313922:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657536 00000100:00100000:1.0:1788586995.313996:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 249 00000100:00080000:3.0:1788586995.314001:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788586995.314009:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110657536:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788586995.314103:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586995.314139:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.314198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110658048 00000100:00100000:2.0:1788586995.314204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110658048 00000100:00100000:1.0:1788586995.314308:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110657536:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 301us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.314313:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110657792 00000100:00100000:1.0:1788586995.314318:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 249 00000100:00100000:3.0:1788586995.314320:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110657792 00000100:00100000:3.0:1788586995.314363:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 105 00000100:00100000:3.0:1788586995.314373:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110657792:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788586995.314549:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110657792:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 178us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.314567:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 105 00000100:00100000:2.0:1788586995.314721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 250 00000100:00100000:2.0:1788586995.314732:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110658048:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788586995.314766:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110658048:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 35us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.314773:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 250 00000100:00080000:2.0:1788586995.314794:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788586995.683175:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586995.683183:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788586995.683205:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788586995.683211:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788586995.818947:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.818995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110658304 00000100:00100000:1.0:1788586995.819006:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110658304 00000100:00100000:1.0:1788586995.819068:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 94 00000100:00100000:1.0:1788586995.819079:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+18:11302:x1875469110658304:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586995.819100:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.819120:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108b4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.819231:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467000/0xfbc93bbea5fd9eec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.819247:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467000/0xfbc93bbea5fd9eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.819260:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467000/0xfbc93bbea5fd9eec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586995.819281:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788586995.819385:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108b4 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.819404:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467000/0xfbc93bbea5fd9eec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108b4 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.819471:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586995.819474:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788586995.819478:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467000, rc 0) 00000100:00100000:1.0:1788586995.819536:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+20:11302:x1875469110658304:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 460us (599us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788586995.819543:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 94 00000100:00100000:0.0:1788586995.830093:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.830516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110658432 00000100:00100000:1.0:1788586995.830526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110658432 00000100:00100000:1.0:1788586995.830588:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 95 00000100:00100000:1.0:1788586995.830598:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+20:11302:x1875469110658432:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:1.0:1788586995.830918:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.830936:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.830948:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.830963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.830971:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.830977:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831054:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831071:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831079:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788586995.831129:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831141:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831147:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831154:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831160:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.831164:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831171:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831182:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586995.831185:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.831190:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831196:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9efa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831214:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831219:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831225:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831230:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.831233:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831239:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831246:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a83482300) 00010000:00010000:1.0:1788586995.831249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.831251:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831256:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831268:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831274:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831280:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831291:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.831295:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831300:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831308:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586995.831311:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.831313:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.831318:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586995.831459:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+20:11302:x1875469110658432:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 860us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.831468:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 95 00000100:00100000:2.0:1788586995.905877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.905984:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110658688 00000100:00100000:1.0:1788586995.905992:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110658688 00000100:00100000:1.0:1788586995.906043:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 96 00000100:00100000:1.0:1788586995.906052:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+20:11305:x1875469110658688:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586995.906069:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.906085:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108bb expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906144:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906169:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906178:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906189:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906193:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906198:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906310:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906316:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906320:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586995.906327:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788586995.906439:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906458:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906465:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906477:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.906482:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906490:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906504:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586995.906507:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.906512:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906529:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906543:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906549:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906555:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906559:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.906561:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906567:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906586:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a83482c00) 00010000:00010000:1.0:1788586995.906588:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586995.906591:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.906598:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.907144:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 23 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.907162:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.907168:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:1.0:1788586995.907171:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788586995.907173:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467a00, rc 0) 00000100:00100000:1.0:1788586995.907243:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+22:11305:x1875469110658688:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1191us (1374us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788586995.907250:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 96 00000100:00100000:0.0:1788586995.911821:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.911877:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110658816 00000100:00100000:1.0:1788586995.911889:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110658816 00000100:00100000:1.0:1788586995.911988:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 97 00000100:00100000:1.0:1788586995.912011:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:11305:x1875469110658816:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788586995.912076:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912092:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912111:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912145:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912152:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912158:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912164:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586995.912168:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912175:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912187:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:1.0:1788586995.912189:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788586995.912194:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.912200:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586995.912461:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:11305:x1875469110658816:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 451us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.912470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 97 00000100:00100000:0.0:1788586995.915254:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.915345:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110659072 00000100:00100000:1.0:1788586995.915360:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110659072 00000100:00100000:1.0:1788586995.915412:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:1.0:1788586995.915464:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:11305:x1875469110659072:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586995.915839:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+23:11305:x1875469110659072:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 376us (591us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788586995.915846:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:2.0:1788586995.953951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.954064:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110659328 00000100:00100000:1.0:1788586995.954076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110659328 00000100:00100000:1.0:1788586995.954134:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 98 00000100:00100000:1.0:1788586995.954145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+23:10828:x1875469110659328:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788586995.954169:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.954190:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f39 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.954305:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.954319:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.954327:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.954358:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.954378:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 24 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586995.954410:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127508096:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788586995.954544:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586995.957110:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127508096:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586995.957145:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586995.957856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586995.958086:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110659456 00000100:00100000:3.0:1788586995.958094:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110659456 00010000:00010000:3.0:1788586995.958134:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 25 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586995.958174:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:3.0:1788586995.958184:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+25:2408:x1875469110659456:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586995.958198:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586995.958205:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 25 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.958218:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 25 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.958259:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fd9f24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108bb expref: 25 pid: 13553 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.958274:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:3.0:1788586995.958278:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.958287:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.958294:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586995.958324:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586995.958380:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+24:2408:x1875469110659456:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 197us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586995.958388:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 65 00010000:00010000:1.0:1788586995.958731:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.958738:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586995.958753:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788586995.958857:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fd9f39 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.958867:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.958873:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:1.0:1788586995.958875:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788586995.958876:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467400, rc 0) 00000100:00100000:1.0:1788586995.958899:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+24:10828:x1875469110659328:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4758us (4963us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788586995.958903:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 98 00000100:00100000:2.0:1788586995.964235:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.964886:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110659584 00000100:00100000:1.0:1788586995.964910:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110659584 00000100:00100000:1.0:1788586995.964965:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 99 00000100:00100000:1.0:1788586995.964975:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+24:10828:x1875469110659584:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788586995.965010:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.965031:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108c9 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.965065:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.965080:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.965091:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.965203:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c9 expref: 26 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.965222:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c9 expref: 25 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.965231:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:1.0:1788586995.965234:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788586995.965237:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467200, rc 0) 00000100:00100000:1.0:1788586995.965303:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+25:10828:x1875469110659584:12345-192.168.203.1@tcp:101:bash.0 Request processed in 329us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586995.965310:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 99 00000100:00100000:2.0:1788586995.971109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.973294:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110659840 00000100:00100000:1.0:1788586995.973327:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110659840 00000100:00100000:0.0:1788586995.973525:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 100 00000100:00100000:0.0:1788586995.973536:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+25:10828:x1875469110659840:12345-192.168.203.1@tcp:36:bash.0 00010000:00010000:0.0:1788586995.973811:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.973828:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.973916:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788586995.973960:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788586995.973979:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8bde9e1 reply state 000000009d54ca5c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.973992:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.973999:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:0.0:1788586995.974002:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788586995.974006:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788586995.974071:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788586995.974205:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+29:10828:x1875469110659840:12345-192.168.203.1@tcp:36:bash.0 Request processed in 669us (3107us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788586995.974213:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 100 00000020:00080000:0.0:1788586995.974218:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788586995.976249:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.976331:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110659968 00000100:00100000:1.0:1788586995.976341:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110659968 00000100:00100000:1.0:1788586995.976408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 101 00000100:00100000:1.0:1788586995.976459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+29:10828:x1875469110659968:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788586995.976482:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586995.976502:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.976549:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d0 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586995.978713:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d0 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586995.978949:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:0.0:1788586995.978953:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788586995.978957:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466e00, rc 0) 00000100:00100000:0.0:1788586995.979044:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:10828:x1875469110659968:12345-192.168.203.1@tcp:101:bash.0 Request processed in 2626us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586995.979070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 101 00000100:00100000:0.0:1788586995.982821:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586995.982965:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110660096 00000100:00100000:2.0:1788586995.982976:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110660096 00000100:00100000:2.0:1788586995.983038:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:2.0:1788586995.983049:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:10828:x1875469110660096:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586995.983078:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586995.983098:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108d7 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788586995.983123:0:10047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9babf2, atime: 0x6a9babf1, ctime: 0x6a9babf2, blocks: 0x8 00010000:00010000:2.0:1788586995.983143:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1788586995.983147:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586995.983155:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 7 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.983171:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 7 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586995.983184:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70000, rc 0) 00000100:00100000:2.0:1788586995.983244:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:10828:x1875469110660096:12345-192.168.203.1@tcp:101:bash.0 Request processed in 197us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586995.983251:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:2.0:1788586995.986401:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586995.986662:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110660224 00000100:00100000:1.0:1788586995.986674:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110660224 00002000:00010000:1.0:1788586995.986715:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788586995.986720:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a836dfb80 with x1875469110660224 ext(0->18446744073709551615) 00002000:00010000:1.0:1788586995.986733:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a836dfb80. 00000100:00100000:1.0:1788586995.986766:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:1.0:1788586995.986777:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110660224:12345-192.168.203.1@tcp:10:bash.0 00002000:00010000:1.0:1788586995.987047:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788586995.987050:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788586994 -> 1788586995 00002000:00010000:1.0:1788586995.987053:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788586993 -> 1788586993 00002000:00010000:1.0:1788586995.987055:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788586994 -> 1788586995 00002000:00010000:1.0:1788586995.987057:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788586995.987132:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110660224:12345-192.168.203.1@tcp:10:bash.0 Request processed in 356us (739us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788586995.987140:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 1 00002000:00010000:1.0:1788586995.987144:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788586995.987146:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a836dfb80 with x1875469110660224 ext(0->18446744073709551615) 00002000:00010000:1.0:1788586995.987151:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a836dfb80. 00000100:00100000:3.0:1788586996.052782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba0528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127508224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586996.052860:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586996.052970:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127508224 00000100:00100000:3.0:1788586996.052979:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127508224 00000100:00080000:0.0:1788586996.056095:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586996.056176:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788586996.056191:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127508224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788586996.056227:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788586996.056309:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127508224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.056316:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788586996.056523:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586996.056540:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127508352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586996.056689:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba0528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127508224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788586996.056794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586996.056885:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127508352 00000100:00100000:1.0:1788586996.056893:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127508352 00000100:00100000:1.0:1788586996.056931:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586996.056938:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875469127508352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788586996.056952:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788586996.057263:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875469127508352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 324us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586996.057272:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586996.057484:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586996.057496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba0528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127508480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788586996.057528:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586996.057665:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127508480 00000100:00100000:2.0:1788586996.057671:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127508480 00000100:00100000:2.0:1788586996.057714:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788586996.057722:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127508480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788586996.057748:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788586996.057798:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127508480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.057804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788586996.057904:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba0528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127508480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788586996.058215:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127508352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586996.068093:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.068246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110660352 00000100:00100000:2.0:1788586996.068256:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110660352 00000100:00100000:2.0:1788586996.068333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:2.0:1788586996.068344:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+30:11319:x1875469110660352:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:2.0:1788586996.068458:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068489:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068505:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068512:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068518:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068709:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068719:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068726:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788586996.068770:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068798:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068804:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068811:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068817:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.068821:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068829:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068841:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.068844:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.068848:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068854:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9f71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068868:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068875:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068881:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068969:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.068974:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068980:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.068989:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834bbc00) 00010000:00010000:2.0:1788586996.068991:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.068994:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069000:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9f78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069016:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069022:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069027:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069032:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.069035:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069041:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069119:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:2.0:1788586996.069122:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.069127:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.069132:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9f7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.069265:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+30:11319:x1875469110660352:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 920us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.069274:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00080000:0.0:1788586996.069341:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586996.111477:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586996.111627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110660608 00000100:00100000:3.0:1788586996.111636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110660608 00000100:00100000:3.0:1788586996.111706:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:3.0:1788586996.111715:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+30:11322:x1875469110660608:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788586996.111735:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586996.111753:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9f86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108de expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111825:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111839:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111852:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111867:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111874:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111880:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.111998:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9f9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112008:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112016:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586996.112035:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788586996.112101:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112109:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112115:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112121:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecce00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586996.112125:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112133:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112143:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:3.0:1788586996.112146:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788586996.112150:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112156:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fd9f8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112169:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112174:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112190:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112195:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecde00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586996.112198:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112203:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112210:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5b85f9f600) 00010000:00010000:3.0:1788586996.112212:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788586996.112214:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112219:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fd9f94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112254:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fd9f86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108de expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112266:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108de expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.112273:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:3.0:1788586996.112275:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788586996.112278:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecc400, rc 0) 00000100:00100000:3.0:1788586996.112329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+32:11322:x1875469110660608:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 616us (861us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788586996.112344:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:1.0:1788586996.115539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.115701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110660736 00000100:00100000:0.0:1788586996.115711:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110660736 00000100:00100000:0.0:1788586996.115770:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00100000:0.0:1788586996.115782:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+32:11322:x1875469110660736:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:0.0:1788586996.115846:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.115862:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.115871:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.115918:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.115931:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 32 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586996.115944:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127508608:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586996.116039:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f300 going to sleep for 11 seconds 00000040:00080000:0.0:1788586996.119973:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788586996.128293:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.128544:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110660992 00000100:00100000:1.0:1788586996.128555:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110660992 00000100:00100000:1.0:1788586996.128617:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:1.0:1788586996.128627:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+33:6643:x1875469110660992:12345-192.168.203.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788586996.128920:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+34:6643:x1875469110660992:12345-192.168.203.1@tcp:35:ldlm_bl.0 Request processed in 293us (637us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788586996.128928:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:2.0:1788586996.129280:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127508608:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586996.129306:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.131135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.131657:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110661120 00000100:00100000:0.0:1788586996.131668:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110661120 00010000:00010000:0.0:1788586996.131709:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 34 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586996.131754:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:0.0:1788586996.131764:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+34:2408:x1875469110661120:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586996.131777:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586996.131784:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 34 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.131798:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 34 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.131819:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fd9f40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c2 expref: 34 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.131856:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:0.0:1788586996.131861:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.131870:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.131877:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.131910:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586996.131971:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+33:2408:x1875469110661120:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 208us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.131979:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 66 00010000:00010000:2.0:1788586996.132051:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132059:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132098:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132105:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132112:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132128:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.132133:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132142:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:2.0:1788586996.132155:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788586996.132158:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.132164:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fd9fa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.132206:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+32:11322:x1875469110660736:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 16427us (16677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.132215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00100000:3.0:1788586996.136831:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.136977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110661376 00000100:00100000:1.0:1788586996.137017:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110661376 00000100:00100000:1.0:1788586996.137078:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:1.0:1788586996.137089:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+32:11322:x1875469110661376:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586996.137321:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+33:11322:x1875469110661376:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 233us (498us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788586996.137329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00010000:00010000:3.0:1788586996.190130:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586996.226741:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.226855:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110661632 00000100:00100000:2.0:1788586996.226866:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110661632 00000100:00100000:2.0:1788586996.227065:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 105 00000100:00100000:2.0:1788586996.227078:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+33:11333:x1875469110661632:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:2.0:1788586996.227104:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.227126:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9fb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108e5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227199:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227235:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227247:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227264:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227271:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227278:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227386:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fd9fc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227396:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fd9fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227403:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fd9fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.227460:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788586996.227537:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227545:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227552:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227565:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.227570:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227578:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227591:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.227595:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.227599:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227606:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9fb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227621:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227627:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227633:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227639:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.227641:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227647:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227664:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a834bbc00) 00010000:00010000:2.0:1788586996.227667:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.227670:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227675:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9fbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227718:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9fb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108e5 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227731:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fd9fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108e5 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.227738:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:2.0:1788586996.227740:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586996.227743:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70600, rc 0) 00000100:00100000:2.0:1788586996.227812:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+35:11333:x1875469110661632:12345-192.168.203.1@tcp:101:cat.0 Request processed in 738us (1079us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788586996.227819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 105 00000100:00100000:3.0:1788586996.233823:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.234048:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110661888 00000100:00100000:1.0:1788586996.234059:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110661888 00000100:00100000:1.0:1788586996.234119:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:1.0:1788586996.234129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+35:11333:x1875469110661888:12345-192.168.203.1@tcp:35:cat.0 00000100:00100000:1.0:1788586996.234407:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+36:11333:x1875469110661888:12345-192.168.203.1@tcp:35:cat.0 Request processed in 277us (592us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788586996.234473:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:3.0:1788586996.263575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.263680:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110662144 00000100:00100000:0.0:1788586996.263690:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110662144 00000100:00100000:0.0:1788586996.263748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 106 00000100:00100000:0.0:1788586996.263758:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+36:11334:x1875469110662144:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:0.0:1788586996.263822:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788586996.263861:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fd9f63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d0 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.263888:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fd9fc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108e5 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.263901:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fd9f9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108de expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.263949:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fd9f55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108c9 expref: 33 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.263959:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:0.0:1788586996.263965:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586996.263986:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.263998:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264007:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264020:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264026:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264032:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264118:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264128:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264135:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788586996.264352:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788586996.264362:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342194945157ns, next at 343194942935ns, rc = 0 00010000:00010000:0.0:1788586996.264408:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264646:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264656:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264663:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264669:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264674:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264697:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788586996.264717:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264723:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264729:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264735:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586996.264746:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264754:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264763:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:0.0:1788586996.264768:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788586996.264772:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264778:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fd9fe1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264793:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264799:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264804:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264809:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586996.264811:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264817:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264824:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586996.264826:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586996.264834:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264841:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fd9fd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788586996.264851:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ea2c902 reply state 00000000843ad411 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264860:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.264865:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:0.0:1788586996.264867:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788586996.264869:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788586996.265106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+34:11334:x1875469110662144:12345-192.168.203.1@tcp:36:rm.0 Request processed in 1347us (1538us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788586996.265114:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 106 00010000:00010000:3.0:1788586996.265687:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586996.265695:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.265702:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586996.265705:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.265712:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.265727:0:10387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:3.0:1788586996.265729:0:10387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788586996.265733:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.265745:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fd9fe8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.265761:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586996.265763:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586996.265764:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788586996.308663:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586996.308686:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788586996.308709:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788586996.308723:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788586996.319695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.319831:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110662400 00000100:00100000:2.0:1788586996.319841:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110662400 00000100:00100000:2.0:1788586996.319902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 107 00000100:00100000:2.0:1788586996.319912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+34:11340:x1875469110662400:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586996.319945:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.319968:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9fef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320086:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320102:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320113:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320124:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320131:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320137:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788586996.320717:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788586996.320854:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320864:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320873:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.320922:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321051:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321057:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321062:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.321067:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321074:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321086:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.321088:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.321092:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321098:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fd9ff6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788586996.321111:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d43d15cc reply state 000000001eb82339 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321121:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321127:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:2.0:1788586996.321129:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788586996.321131:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788586996.321162:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fd9fef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321183:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.321191:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:2.0:1788586996.321194:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586996.321196:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70400, rc 0) 00000100:00100000:2.0:1788586996.321312:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+37:11340:x1875469110662400:12345-192.168.203.1@tcp:101:bash.0 Request processed in 1400us (1625us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788586996.321320:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 107 00000100:00100000:1.0:1788586996.335918:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586996.336021:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110662528 00000100:00100000:3.0:1788586996.336031:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110662528 00000100:00100000:3.0:1788586996.336137:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:3.0:1788586996.336149:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110662528:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788586996.336166:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586996.336185:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108f3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788586996.336212:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788586996.336230:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1788586996.336235:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586996.336245:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.336264:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.336277:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecca00, rc 0) 00000100:00100000:3.0:1788586996.336351:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110662528:12345-192.168.203.1@tcp:101:bash.0 Request processed in 204us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586996.336372:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:3.0:1788586996.340486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.340742:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110662656 00000100:00100000:2.0:1788586996.340752:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110662656 00000100:00100000:2.0:1788586996.340822:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:2.0:1788586996.340832:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+8:11340:x1875469110662656:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586996.340849:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.340866:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8108fa expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.341066:0:10047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.341076:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586996.341081:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586996.341086:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 9 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.341318:0:10047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.341332:0:10047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.341346:0:10047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10047:1875469127508736:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586996.341529:0:10047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788586996.344339:0:10047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10047:1875469127508736:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586996.344388:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 9 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.344408:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70200, rc 0) 00000100:00100000:2.0:1788586996.344546:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+9:11340:x1875469110662656:12345-192.168.203.1@tcp:101:bash.0 Request processed in 3714us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.344562:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:1.0:1788586996.348102:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586996.348396:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110662784 00000100:00100000:3.0:1788586996.348499:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110662784 00010000:00010000:3.0:1788586996.348542:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.348815:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:3.0:1788586996.348826:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110662784:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586996.348841:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586996.348862:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.348875:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.348898:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda012 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108f3 expref: 9 pid: 8436 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.348915:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586996.348920:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586996.348927:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.348938:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.348973:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.349016:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbfb54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1875469127508864:192.168.203.1@tcp:105: 00000100:00100000:3.0:1788586996.349102:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8a15ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586996.353006:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbfb54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1875469127508864:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788586996.353032:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586996.353097:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110662784:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 4271us (5004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.353107:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:1.0:1788586996.355143:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.355298:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110663040 00000100:00100000:0.0:1788586996.355313:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110663040 00000100:00100000:0.0:1788586996.355770:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:0.0:1788586996.355781:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+37:11340:x1875469110663040:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:0.0:1788586996.356070:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+38:11340:x1875469110663040:12345-192.168.203.1@tcp:35:bash.0 Request processed in 290us (933us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788586996.356078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:1.0:1788586996.489724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.489832:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110663168 00000100:00100000:2.0:1788586996.489842:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110663168 00000100:00100000:2.0:1788586996.489915:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 108 00000100:00100000:2.0:1788586996.489926:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+38:11356:x1875469110663168:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.489949:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.489970:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810901 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.490036:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.490049:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.490060:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.490102:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788586996.490106:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586996.490123:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.490574:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810901 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.490594:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810901 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.490605:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.490608:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788586996.490611:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71800, rc 0) 00000100:00100000:2.0:1788586996.490681:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+39:11356:x1875469110663168:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 756us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.490698:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 108 00000100:00100000:3.0:1788586996.498342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.498458:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110663424 00000100:00100000:0.0:1788586996.498468:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110663424 00000100:00100000:0.0:1788586996.498530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 109 00000100:00100000:0.0:1788586996.498544:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+39:11356:x1875469110663424:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788586996.498583:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586996.498603:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda02e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810908 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.498711:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.498725:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.498737:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586996.498749:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788586996.498852:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda02e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810908 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.498870:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810908 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.498878:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:0.0:1788586996.498881:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788586996.498885:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788586996.498950:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+41:11356:x1875469110663424:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 411us (616us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788586996.498957:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 109 00000100:00100000:0.0:1788586996.504577:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.504620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586996.504791:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110663808 00000100:00100000:3.0:1788586996.504801:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110663808 00000100:00100000:3.0:1788586996.504878:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:3.0:1788586996.504887:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+41:2408:x1875469110663808:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586996.504901:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586996.504930:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810908 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.504947:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:3.0:1788586996.504952:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586996.505183:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+40:2408:x1875469110663808:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 296us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586996.505191:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:2.0:1788586996.506093:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110663680 00000100:00100000:2.0:1788586996.506102:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110663680 00000100:00100000:2.0:1788586996.506277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 110 00000100:00100000:2.0:1788586996.506287:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+40:11356:x1875469110663680:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.506320:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.506341:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda043 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81090f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.506571:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda04a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.506586:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.506597:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.506608:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788586996.506697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda043 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81090f expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.506712:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda04a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81090f expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.506720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:2.0:1788586996.506723:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788586996.506726:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71e00, rc 0) 00000100:00100000:2.0:1788586996.506778:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+42:11356:x1875469110663680:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 494us (2225us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788586996.506913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 110 00000100:00100000:3.0:1788586996.514471:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.515523:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110663936 00000100:00100000:2.0:1788586996.515536:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110663936 00000100:00100000:2.0:1788586996.515609:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:2.0:1788586996.515620:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110663936:12345-192.168.203.1@tcp:1:lfs.0 00010000:00010000:2.0:1788586996.515663:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.515683:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.515691:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586996.515695:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788586996.515700:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.515734:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.515748:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 8 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.515762:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1875469127508992:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586996.516086:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788586996.522373:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1875469127508992:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586996.522403:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.522972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.523245:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110664064 00000100:00100000:0.0:1788586996.523265:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110664064 00002000:00100000:0.0:1788586996.523324:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f5bbfb54000 x1875469110664064/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:312/0 lens 504/0 e 0 to 0 dl 1788587007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788586996.523334:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5bbfb54000 with x1875469110664064 ext(0->8) 00010000:00010000:0.0:1788586996.523341:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 9 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.523357:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 9 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788586996.523365:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5bbfb54000 00000100:00100000:0.0:1788586996.523397:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:0.0:1788586996.523407:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:2408:x1875469110664064:12345-192.168.203.1@tcp:4:lfs.0 00000100:00100000:0.0:1788586996.529775:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+11:2408:x1875469110664064:12345-192.168.203.1@tcp:4:lfs.0 Request processed in 6359us (6793us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788586996.529788:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 1 00002000:00100000:0.0:1788586996.529802:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f5bbfb54000 x1875469110664064/t4294967303(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:312/0 lens 504/448 e 0 to 0 dl 1788587007 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788586996.529812:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5bbfb54000 with x1875469110664064 ext(0->8) 00010000:00010000:0.0:1788586996.529822:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 11 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.529842:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 11 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788586996.529850:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5bbfb54000 00000100:00100000:0.0:1788586996.532797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.532890:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110664192 00000100:00100000:1.0:1788586996.532900:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110664192 00010000:00010000:1.0:1788586996.532942:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 11 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586996.532986:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 68 00000100:00100000:1.0:1788586996.532996:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+11:2409:x1875469110664192:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586996.533012:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788586996.533031:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788586996.533044:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788586996 00002000:00010000:1.0:1788586996.533046:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788586996 00002000:00010000:1.0:1788586996.533048:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788586996 00002000:00010000:1.0:1788586996.533051:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788586996.533059:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 11 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.533073:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 11 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.533098:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009243e8a/0xfbc93bbea5fda019 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108fa expref: 11 pid: 10047 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.533128:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788586996.533133:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788586996.533138:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.533149:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.533185:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586996.533223:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533236:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586996.533245:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110664192:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 247us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586996.533254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 68 00010000:00010000:3.0:1788586996.533259:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533277:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533284:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533292:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586996.533296:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533306:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533319:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586996.533328:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fda058 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.533389:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110663936:12345-192.168.203.1@tcp:1:lfs.0 Request processed in 17770us (18971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586996.533398:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:1.0:1788586996.536378:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.536635:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110664448 00000100:00100000:0.0:1788586996.536644:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110664448 00000100:00100000:0.0:1788586996.536701:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:0.0:1788586996.536711:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+42:11356:x1875469110664448:12345-192.168.203.1@tcp:35:lfs.0 00000004:00010000:0.0:1788586996.536771:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda04a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81090f expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788586996.536983:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788586996.537015:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788586996.537322:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788586996.537355:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.537370:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.537380:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.537412:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.537488:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 46 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586996.537502:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba0529180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875469127509120:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586996.537582:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788586996.544330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.544475:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba0529180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1875469127509120:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586996.544510:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.544750:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110664576 00000100:00100000:2.0:1788586996.544758:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110664576 00010000:00010000:2.0:1788586996.544797:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 47 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.544835:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:2.0:1788586996.544845:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+47:2409:x1875469110664576:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586996.544858:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586996.544865:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 47 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.544877:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 47 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.544898:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda004 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108ec expref: 47 pid: 6521 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.544914:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:2.0:1788586996.544919:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.544928:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.544946:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.544975:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586996.545033:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+46:2409:x1875469110664576:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 189us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.545040:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 69 00010000:00010000:1.0:1788586996.545128:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.545135:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788586996.545242:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788586996.545353:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788586996.545474:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a837e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875469127509248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788586996.545527:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586996.545564:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8523a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586996.545658:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127509248 00000100:00100000:3.0:1788586996.545662:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127509248 00000100:00100000:3.0:1788586996.545687:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788586996.545698:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1875469127509248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788586996.545766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1875469127509248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586996.545773:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788586996.548146:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a837e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875469127509248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788586996.548380:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788586996.548643:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875469127509376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788586996.548773:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586996.548804:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8523a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788586996.549056:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127509376 00000100:00100000:2.0:1788586996.549065:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127509376 00000100:00100000:2.0:1788586996.549117:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788586996.549127:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1875469127509376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788586996.549272:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1875469127509376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (500us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788586996.549280:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788586996.549388:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1875469127509376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788586996.549490:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788586996.549527:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.549537:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.549545:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.549751:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586996.549756:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.549764:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.549787:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:1.0:1788586996.549790:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788586996.549795:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.549801:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda05f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788586996.549903:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788586996.549957:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788586996.549970:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342480553411ns, next at 343480550814ns, rc = 0 00000001:00080000:1.0:1788586996.549976:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788586996.549998:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a834bbc00) 00010000:00010000:1.0:1788586996.550001:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788586996.550008:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda04a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81090f expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586996.550146:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+49:11356:x1875469110664448:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 13436us (13775us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788586996.550154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 26 00000020:00080000:1.0:1788586996.550158:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788586996.555570:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.555598:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110664704 00000100:00100000:1.0:1788586996.555609:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110664704 00000100:00100000:1.0:1788586996.555713:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 111 00000100:00100000:1.0:1788586996.555724:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+49:11356:x1875469110664704:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586996.555748:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586996.555769:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810916 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.555831:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810916 expref: 50 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.555846:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810916 expref: 50 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.555865:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586996.555868:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788586996.555871:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466a00, rc 0) 00000100:00100000:1.0:1788586996.555934:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+50:11356:x1875469110664704:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 212us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586996.555941:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 111 00000100:00100000:3.0:1788586996.558352:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.558479:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110664960 00000100:00100000:1.0:1788586996.558489:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110664960 00000100:00100000:1.0:1788586996.558537:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:1.0:1788586996.558546:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+50:11356:x1875469110664960:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586996.559112:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+51:11356:x1875469110664960:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 565us (767us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788586996.559120:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:2.0:1788586996.655654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.655854:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110665088 00000100:00100000:1.0:1788586996.655864:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110665088 00000100:00100000:1.0:1788586996.655925:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 112 00000100:00100000:1.0:1788586996.655935:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+51:11366:x1875469110665088:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:1.0:1788586996.656015:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656032:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656043:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656054:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656061:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656068:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656138:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656147:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656154:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788586996.656306:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656335:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656342:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656349:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656355:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586996.656358:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656365:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656377:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586996.656381:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586996.656386:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656392:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda06d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656406:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656412:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656631:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656641:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586996.656645:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656651:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656659:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:1.0:1788586996.656662:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586996.656665:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656671:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda074 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656682:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656687:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656692:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656697:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586996.656700:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656705:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656724:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586996.656726:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586996.656729:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.656735:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda07b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.656928:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+51:11366:x1875469110665088:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 990us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586996.656937:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 112 00000100:00100000:0.0:1788586996.689901:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.690096:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110665344 00000100:00100000:2.0:1788586996.690107:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110665344 00000100:00100000:2.0:1788586996.690209:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 113 00000100:00100000:2.0:1788586996.690220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+51:11369:x1875469110665344:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.690241:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.690261:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda082 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81091d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690336:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690350:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690375:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690387:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690394:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690401:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690555:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690564:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690570:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.690578:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788586996.690664:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690672:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690679:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690685:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.690698:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690706:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690717:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.690719:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.690723:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690729:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda089 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690741:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690746:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690751:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690756:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.690759:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690764:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690770:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:2.0:1788586996.690772:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.690780:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690786:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda090 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690817:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda082 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690829:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.690836:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.690838:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586996.690840:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70e00, rc 0) 00000100:00100000:2.0:1788586996.690908:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+53:11369:x1875469110665344:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 690us (1018us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788586996.690916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 113 00000100:00100000:3.0:1788586996.693235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.693368:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110665472 00000100:00100000:1.0:1788586996.693378:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110665472 00000100:00100000:1.0:1788586996.693473:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 114 00000100:00100000:1.0:1788586996.693484:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+53:11369:x1875469110665472:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788586996.693549:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693564:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693575:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693606:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693613:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693619:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693623:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586996.693644:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693650:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693659:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586996.693660:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788586996.693663:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.693668:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda0a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586996.693720:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+53:11369:x1875469110665472:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 238us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586996.693727:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 114 00000100:00100000:0.0:1788586996.695146:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.696192:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110665728 00000100:00100000:1.0:1788586996.696205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110665728 00000100:00100000:1.0:1788586996.696268:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:1.0:1788586996.696278:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+53:11369:x1875469110665728:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788586996.696536:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:11369:x1875469110665728:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 259us (1396us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788586996.696545:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:3.0:1788586996.758296:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.758460:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110665984 00000100:00100000:2.0:1788586996.758470:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110665984 00000100:00100000:2.0:1788586996.758534:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 115 00000100:00100000:2.0:1788586996.758545:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+54:11379:x1875469110665984:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586996.758569:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.758572:0:13553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788586996.758601:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810901 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.758619:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.758634:0:13553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586996.758669:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810924 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.758773:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.758787:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.758796:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.758826:0:13553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.758839:0:13553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 54 pid: 6522 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.758852:0:13553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127509504:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586996.758951:0:13553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586996.762245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.762495:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110666112 00000100:00100000:0.0:1788586996.762505:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110666112 00010000:00010000:0.0:1788586996.762550:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 55 pid: 6522 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586996.762595:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00100000:0.0:1788586996.762606:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+55:2409:x1875469110666112:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586996.762622:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586996.762629:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 55 pid: 6522 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.762642:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 55 pid: 6522 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.762647:0:13553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127509504:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586996.762665:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda097 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81091d expref: 55 pid: 6522 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.762671:0:13553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.762679:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:0.0:1788586996.762683:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.762693:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.762700:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.762737:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586996.762744:0:13553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.762750:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.762776:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:0.0:1788586996.762791:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+54:2409:x1875469110666112:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 187us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.762797:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 70 00010000:00010000:2.0:1788586996.762897:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 55 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.762912:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 54 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.762919:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.762921:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788586996.762924:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71000, rc 0) 00000100:00100000:2.0:1788586996.762948:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+54:11379:x1875469110665984:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4407us (4664us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788586996.762955:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 115 00000100:00100000:3.0:1788586996.765322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.768613:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110666240 00000100:00100000:2.0:1788586996.768628:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110666240 00000100:00100000:2.0:1788586996.768706:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 116 00000100:00100000:2.0:1788586996.768717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+54:11379:x1875469110666240:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586996.768742:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.768763:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81092b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.768798:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.768813:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.768844:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.768957:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.768977:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.768985:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.768988:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788586996.768992:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71400, rc 0) 00000100:00100000:2.0:1788586996.769063:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+55:11379:x1875469110666240:12345-192.168.203.1@tcp:101:bash.0 Request processed in 349us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.769070:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 116 00000100:00100000:0.0:1788586996.772286:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.772669:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110666496 00000100:00100000:2.0:1788586996.772680:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110666496 00000100:00100000:2.0:1788586996.772777:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00100000:2.0:1788586996.772788:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+55:11379:x1875469110666496:12345-192.168.203.1@tcp:36:bash.0 00010000:00010000:2.0:1788586996.773041:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.773059:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.773070:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788586996.773138:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788586996.773162:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d6126a9 reply state 00000000bc76c0d4 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.773175:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.773183:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.773187:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788586996.773190:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788586996.773336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:11379:x1875469110666496:12345-192.168.203.1@tcp:36:bash.0 Request processed in 548us (1057us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788586996.773344:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 117 00000020:00080000:2.0:1788586996.773348:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788586996.775814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.775967:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110666624 00000100:00100000:2.0:1788586996.775976:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110666624 00000100:00100000:2.0:1788586996.776036:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 118 00000100:00100000:2.0:1788586996.776046:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+58:11379:x1875469110666624:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788586996.776070:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.776090:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda0d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810932 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.776179:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.776194:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 59 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.776222:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.776256:0:13553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 59 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.776268:0:13553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 59 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.776283:0:13553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127509632:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586996.776352:0:13553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788586996.778190:0:13553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127509632:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586996.778218:0:13553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586996.779235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.779812:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110666752 00000100:00100000:2.0:1788586996.779821:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110666752 00010000:00010000:2.0:1788586996.779860:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 60 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.779900:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 71 00000100:00100000:2.0:1788586996.779910:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+60:2408:x1875469110666752:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586996.779922:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586996.779928:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 60 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.779953:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 60 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.779974:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810924 expref: 60 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.779989:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.780003:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.780013:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.780020:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.780046:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586996.780093:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+59:2408:x1875469110666752:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 184us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.780100:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 71 00010000:00010000:1.0:1788586996.780239:0:13553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.780248:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586996.780312:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788586996.780316:0:13553:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788586996.780336:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.780378:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda0d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 59 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.780392:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 58 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.780399:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586996.780401:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788586996.780403:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70200, rc 0) 00000100:00100000:1.0:1788586996.780627:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+58:11379:x1875469110666624:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4422us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586996.780635:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 118 00000100:00100000:3.0:1788586996.783916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.784009:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110667008 00000100:00100000:0.0:1788586996.784018:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110667008 00000100:00100000:0.0:1788586996.784072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:0.0:1788586996.784082:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+58:11379:x1875469110667008:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:0.0:1788586996.784323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+59:11379:x1875469110667008:12345-192.168.203.1@tcp:35:bash.0 Request processed in 241us (414us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788586996.784331:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:1.0:1788586996.836197:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.836293:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110667136 00000100:00100000:2.0:1788586996.836303:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110667136 00000100:00100000:2.0:1788586996.836369:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 119 00000100:00100000:2.0:1788586996.836379:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+59:11385:x1875469110667136:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.836405:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.836477:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810939 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.836875:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.836890:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.836902:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.836948:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788586996.836952:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586996.836973:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.836997:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810939 expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.837015:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810939 expref: 60 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.837024:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.837027:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788586996.837031:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71c00, rc 0) 00000100:00100000:2.0:1788586996.837137:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110667136:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 759us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.837144:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 119 00000100:00100000:3.0:1788586996.844111:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.844206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110667264 00000100:00100000:2.0:1788586996.844217:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110667264 00000100:00100000:2.0:1788586996.844290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 120 00000100:00100000:2.0:1788586996.844300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110667264:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.844320:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.844340:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810940 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844409:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844470:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844483:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844495:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844502:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844507:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844586:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844594:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844600:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586996.844653:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788586996.844657:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586996.844675:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844687:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844695:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844700:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844707:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844712:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.844717:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844724:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844735:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:2.0:1788586996.844738:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.844743:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844748:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda0f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844770:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844776:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844782:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844786:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586996.844789:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844795:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844802:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:2.0:1788586996.844804:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586996.844807:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844812:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda0f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810940 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844848:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810940 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.844866:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.844868:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788586996.844871:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70800, rc 0) 00000100:00100000:2.0:1788586996.844934:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:11385:x1875469110667264:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 635us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.844940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 120 00000100:00100000:3.0:1788586996.848504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586996.848745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110667520 00000100:00100000:1.0:1788586996.848755:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110667520 00000100:00100000:1.0:1788586996.848826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:1.0:1788586996.848838:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+61:2409:x1875469110667520:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586996.848853:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586996.848877:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda107 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810940 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.848899:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586996.848917:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586996.848970:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+60:2409:x1875469110667520:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 135us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586996.848979:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:1.0:1788586996.851119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.851243:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110667648 00000100:00100000:2.0:1788586996.851253:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110667648 00000100:00100000:2.0:1788586996.851314:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 121 00000100:00100000:2.0:1788586996.851323:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110667648:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.851343:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.851372:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda10e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810947 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.851513:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.851528:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 61 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.851537:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.851580:0:13553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 61 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.851593:0:13553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 61 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.851623:0:13553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127509760:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586996.851717:0:13553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788586996.854359:0:13553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127509760:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586996.854391:0:13553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586996.855598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.855709:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110667776 00000100:00100000:2.0:1788586996.855718:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110667776 00010000:00010000:2.0:1788586996.855757:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 62 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586996.855801:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:2.0:1788586996.855812:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+62:2409:x1875469110667776:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586996.855826:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586996.855833:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 62 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.855861:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 62 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.855884:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda0dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810932 expref: 62 pid: 13553 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.855898:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.855904:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.855920:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.855928:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.855959:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586996.856016:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:2409:x1875469110667776:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 205us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.856024:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 72 00010000:00010000:1.0:1788586996.856199:0:13553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.856208:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586996.856227:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788586996.856463:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda10e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 62 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.856481:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 61 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586996.856489:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586996.856492:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788586996.856495:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70a00, rc 0) 00000100:00100000:1.0:1788586996.857526:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a837e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+61:11385:x1875469110667648:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 6196us (6408us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788586996.857536:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 121 00000100:00100000:1.0:1788586996.867517:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586996.867591:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668032 00000100:00100000:0.0:1788586996.867601:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668032 00000100:00100000:0.0:1788586996.867663:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:0.0:1788586996.867673:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+61:11385:x1875469110668032:12345-192.168.203.1@tcp:103:lfs.0 00010000:00010000:0.0:1788586996.867689:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586996.867713:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810916 expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586996.867730:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:0.0:1788586996.867735:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586996.867789:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110668032:12345-192.168.203.1@tcp:103:lfs.0 Request processed in 118us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.867797:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:1.0:1788586996.872263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.872380:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668160 00000100:00100000:2.0:1788586996.872390:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668160 00000100:00100000:2.0:1788586996.874348:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 122 00000100:00100000:2.0:1788586996.874368:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110668160:12345-192.168.203.1@tcp:58:lfs.0 00010000:00010000:2.0:1788586996.874534:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.874552:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.874564:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788586996.874655:0:10048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788586996.874803:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110668160:12345-192.168.203.1@tcp:58:lfs.0 Request processed in 443us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.874812:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 122 00000100:00100000:3.0:1788586996.882661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586996.884876:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668288 00000100:00100000:2.0:1788586996.885275:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668288 00000100:00100000:2.0:1788586996.885411:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 123 00000100:00100000:2.0:1788586996.885455:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+60:11385:x1875469110668288:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586996.885478:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586996.885500:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81094e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.885569:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.885581:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.885608:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.885623:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.885638:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586996.885641:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586996.885645:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586996.885663:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71000, rc 0) 00000100:00100000:2.0:1788586996.885796:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+61:11385:x1875469110668288:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 345us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.885804:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 123 00010000:00010000:3.0:1788586997.205260:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788586997.332630:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586997.332638:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788586997.332689:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788586997.332699:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788586997.332839:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127509888:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788586997.333003:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd300 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.342664:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127509888:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788586997.343495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.343955:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668416 00000100:00100000:2.0:1788586997.343963:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668416 00000100:00100000:2.0:1788586997.344026:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 124 00000100:00100000:2.0:1788586997.344038:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+61:11386:x1875469110668416:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788586997.344069:0:13553:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788586997.344204:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+61:11386:x1875469110668416:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 167us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.344212:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 124 00000100:00100000:3.0:1788586997.353042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.353133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668544 00000100:00100000:0.0:1788586997.353144:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668544 00000100:00100000:0.0:1788586997.353214:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 125 00000100:00100000:0.0:1788586997.353225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:11386:x1875469110668544:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788586997.353296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353325:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353340:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353348:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353355:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353401:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353408:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586997.353493:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788586997.353510:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788586997.353523:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353533:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353539:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353650:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353655:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586997.353660:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353667:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353680:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:0.0:1788586997.353683:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586997.353688:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353694:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda131 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353707:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353713:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353730:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353735:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586997.353738:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353745:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353754:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8f5baaa90400) 00010000:00010000:0.0:1788586997.353757:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586997.353760:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353765:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda138 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353780:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353786:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353792:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353797:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788586997.353801:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353817:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353826:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:0.0:1788586997.353828:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788586997.353831:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.353837:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda13f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.353920:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:11386:x1875469110668544:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 Request processed in 695us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.353927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 125 00000100:00100000:3.0:1788586997.357999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.358098:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668800 00000100:00100000:2.0:1788586997.358108:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668800 00000100:00100000:2.0:1788586997.358172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 126 00000100:00100000:2.0:1788586997.358183:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+61:11386:x1875469110668800:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586997.358211:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586997.358232:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda146 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358336:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358352:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358367:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586997.358377:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788586997.358496:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358514:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358521:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358526:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586997.358529:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358537:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358668:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586997.358672:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788586997.358677:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358684:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda14d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358723:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda146 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810955 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358734:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:2.0:1788586997.358736:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788586997.358740:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda146 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810955 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.358750:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71800, rc 0) 00000100:00100000:2.0:1788586997.358814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+62:11386:x1875469110668800:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 633us (824us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788586997.358822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 126 00000100:00100000:1.0:1788586997.362273:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.362371:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110668928 00000100:00100000:2.0:1788586997.362380:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110668928 00000100:00100000:2.0:1788586997.362480:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:2.0:1788586997.362490:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+62:11386:x1875469110668928:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788586997.362522:0:10048:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788586997.362630:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+62:11386:x1875469110668928:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 141us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.362638:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:3.0:1788586997.366347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.366458:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110669184 00000100:00100000:0.0:1788586997.366466:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110669184 00000100:00100000:0.0:1788586997.366518:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:0.0:1788586997.366526:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+62:11386:x1875469110669184:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788586997.366548:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586997.366551:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788586997.366575:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda0eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810939 expref: 62 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.366593:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:0.0:1788586997.366597:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788586997.366609:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda15b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81095c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788586997.366998:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788586997.367111:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.367123:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.367133:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.367180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda15b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81095c expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.367194:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81095c expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.367201:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:0.0:1788586997.367203:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788586997.367205:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788586997.367267:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+63:11386:x1875469110669184:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 741us (928us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788586997.367275:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:3.0:1788586997.370698:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586997.370830:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110669440 00000100:00100000:1.0:1788586997.370841:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110669440 00000100:00100000:1.0:1788586997.370910:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 129 00000100:00100000:1.0:1788586997.370920:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+63:11386:x1875469110669440:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788586997.371007:0:13553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586997.371035:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81095c expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371056:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90400) 00010000:00010000:1.0:1788586997.371067:0:13553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788586997.371087:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371099:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371109:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371122:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371128:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371134:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371174:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371533:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371605:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371612:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.371617:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371624:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371634:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586997.371637:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.371640:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371645:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467c00/0xfbc93bbea5fda170 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371656:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371660:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371666:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371670:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.371681:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371688:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371696:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xcef50a87 (ffff8f5a83482500) 00010000:00010000:1.0:1788586997.371698:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.371701:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.371707:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda177 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xcef50a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.372233:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+62:11386:x1875469110669440:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 1311us (1540us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788586997.372243:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 129 00000100:00100000:1.0:1788586997.374820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.376707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110669568 00000100:00100000:0.0:1788586997.376720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110669568 00000100:00100000:0.0:1788586997.376927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 130 00000100:00100000:0.0:1788586997.376939:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+62:11386:x1875469110669568:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788586997.376957:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586997.376990:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda17e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810963 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.377033:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.377046:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.377057:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.377151:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda17e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.377168:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.377177:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:0.0:1788586997.377181:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788586997.377184:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788586997.377255:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+63:11386:x1875469110669568:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 318us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.377262:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 130 00000100:00100000:3.0:1788586997.380819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.381038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110669824 00000100:00100000:2.0:1788586997.381049:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110669824 00000100:00100000:2.0:1788586997.381106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 131 00000100:00100000:2.0:1788586997.381115:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+63:11386:x1875469110669824:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788586997.381195:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.381212:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.381224:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788586997.381369:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788586997.381378:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343311961727ns, next at 344311959099ns, rc = 0 00000004:00010000:2.0:1788586997.381535:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef807b1 reply state 0000000050d387be transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.381573:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.381581:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:2.0:1788586997.381583:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788586997.381587:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788586997.381701:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+65:11386:x1875469110669824:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 586us (890us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788586997.381708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 131 00000100:00100000:1.0:1788586997.384398:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.384536:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110669952 00000100:00100000:2.0:1788586997.384553:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110669952 00000100:00100000:2.0:1788586997.384608:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 132 00000100:00100000:2.0:1788586997.384617:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+65:11386:x1875469110669952:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586997.384639:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586997.384659:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81096a expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.384734:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 66 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.384750:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 66 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.384769:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:2.0:1788586997.384772:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586997.384775:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70400, rc 0) 00000100:00100000:2.0:1788586997.384831:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+66:11386:x1875469110669952:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 215us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.384843:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 132 00000100:00100000:1.0:1788586997.387769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.388130:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110670080 00000100:00100000:3.0:1788586997.388139:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110670080 00000100:00100000:3.0:1788586997.388209:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:3.0:1788586997.388220:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110670080:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788586997.388538:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788586997.388557:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110670080:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 338us (794us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788586997.388566:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:0.0:1788586997.390588:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586997.390886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110670336 00000100:00100000:1.0:1788586997.390894:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110670336 00000100:00100000:1.0:1788586997.390935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:1.0:1788586997.390943:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+66:11386:x1875469110670336:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788586997.391127:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+67:11386:x1875469110670336:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 182us (545us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788586997.391134:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:1.0:1788586997.392858:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.392956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110670592 00000100:00100000:0.0:1788586997.392963:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110670592 00000100:00100000:0.0:1788586997.393017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 133 00000100:00100000:0.0:1788586997.393027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:11386:x1875469110670592:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788586997.393173:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:11386:x1875469110670592:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.393179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 133 00000100:00100000:3.0:1788586997.394905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.394980:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110670720 00000100:00100000:2.0:1788586997.394987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110670720 00000100:00100000:2.0:1788586997.395097:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 134 00000100:00100000:2.0:1788586997.395107:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+67:11386:x1875469110670720:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586997.395125:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586997.395143:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda19a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810971 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.395229:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.395244:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.395255:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586997.395296:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788586997.395315:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.395341:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda19a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810971 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.395371:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810971 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.395380:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:2.0:1788586997.395390:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788586997.395394:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71c00, rc 0) 00000100:00100000:2.0:1788586997.395601:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+68:11386:x1875469110670720:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 494us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.395608:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 134 00000100:00100000:2.0:1788586997.397603:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.397684:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110670848 00000100:00100000:3.0:1788586997.397695:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110670848 00000100:00100000:3.0:1788586997.397774:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:3.0:1788586997.397784:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110670848:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788586997.397798:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586997.397817:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810978 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788586997.397839:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9babf5, blocks: 0x0 00010000:00010000:3.0:1788586997.397922:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1788586997.397928:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586997.397937:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.397952:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.397984:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd600, rc 0) 00000100:00100000:3.0:1788586997.398135:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110670848:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 352us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.398143:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:1.0:1788586997.400676:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.400767:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671104 00000100:00100000:2.0:1788586997.400777:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671104 00000100:00100000:2.0:1788586997.400887:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 135 00000100:00100000:2.0:1788586997.400897:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+68:11386:x1875469110671104:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788586997.401011:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+68:11386:x1875469110671104:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.401019:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 135 00000100:00100000:1.0:1788586997.403826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.403939:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671232 00000100:00100000:2.0:1788586997.403949:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671232 00000100:00100000:2.0:1788586997.404068:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:2.0:1788586997.404079:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+10:11386:x1875469110671232:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788586997.404096:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586997.404112:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81097f expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.404141:0:10047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.404148:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586997.404152:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586997.404170:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 11 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.404217:0:10047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.404231:0:10047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.404244:0:10047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10047:1875469127510016:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586997.404345:0:10047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.407082:0:10047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836ded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10047:1875469127510016:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788586997.407121:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 11 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.407141:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71600, rc 0) 00000100:00100000:2.0:1788586997.407254:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+11:11386:x1875469110671232:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 3177us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.407640:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:1.0:1788586997.408318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.408618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671360 00000100:00100000:2.0:1788586997.408627:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671360 00010000:00010000:2.0:1788586997.408663:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.408698:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 73 00000100:00100000:2.0:1788586997.408708:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+11:2409:x1875469110671360:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586997.408736:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586997.408827:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.409036:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.409065:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847dba36/0xfbc93bbea5fda1a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810978 expref: 11 pid: 8436 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.409082:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586997.409086:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788586997.409095:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 10 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.409105:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 10 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.409698:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 10 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.409717:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1875469127510144:192.168.203.1@tcp:105: 00000100:00100000:2.0:1788586997.410054:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788586997.413999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.414026:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836ded80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1875469127510144:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788586997.414052:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586997.414115:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110671360:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 5408us (5798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.414124:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 73 00000100:00100000:2.0:1788586997.415518:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671488 00000100:00100000:2.0:1788586997.415527:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671488 00002000:00100000:2.0:1788586997.415569:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f5ba0528000 x1875469110671488/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:313/0 lens 504/0 e 0 to 0 dl 1788587008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788586997.415580:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5ba0528000 with x1875469110671488 ext(0->12) 00002000:00010000:2.0:1788586997.415585:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5ba0528000 00000100:00100000:2.0:1788586997.415610:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:2.0:1788586997.415619:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:2408:x1875469110671488:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788586997.418674:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+12:2408:x1875469110671488:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 Request processed in 3045us (4674us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788586997.418688:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 2 00002000:00100000:2.0:1788586997.418700:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f5ba0528000 x1875469110671488/t4294967309(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:313/0 lens 504/448 e 0 to 0 dl 1788587008 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788586997.418709:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5ba0528000 with x1875469110671488 ext(0->12) 00002000:00010000:2.0:1788586997.418715:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5ba0528000 00000100:00100000:1.0:1788586997.424056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.424864:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671616 00000100:00100000:2.0:1788586997.424875:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671616 00000100:00100000:2.0:1788586997.424944:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 136 00000100:00100000:2.0:1788586997.424955:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+68:11386:x1875469110671616:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788586997.431254:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788586997.431271:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788586997.431315:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788586997.431539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127510272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788586997.431617:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.431664:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586997.431671:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a836dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127510400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788586997.431695:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.431727:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127510272 00000100:00100000:2.0:1788586997.431734:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127510272 00000100:00100000:2.0:1788586997.431782:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127510400 00000100:00100000:2.0:1788586997.431785:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127510400 00000100:00100000:2.0:1788586997.431801:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788586997.431809:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875469127510272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788586997.431833:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788586997.431860:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.431882:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 11 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.431891:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788586997.431895:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788586997.431899:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.431941:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 11 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.431954:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 11 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.431965:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbfb55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127510528:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788586997.432034:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a780 going to sleep for 11 seconds 00000100:00080000:2.0:1788586997.432046:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788586997.432061:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788586997.432068:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875469127510400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788586997.432169:0:10047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788586997.432173:0:10047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788586997 00002000:00010000:2.0:1788586997.432175:0:10047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788586997.432178:0:10047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788586997 -> 1788586997 00002000:00010000:2.0:1788586997.432180:0:10047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788586997.432219:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1875469127510400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (523us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788586997.432227:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1788586997.432267:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a836dc380/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788586997.432273:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127510400:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788586997.434121:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434136:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434143:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434148:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.434152:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434160:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434176:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f5a83482400) 00010000:00010000:1.0:1788586997.434179:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.434184:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434190:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fd9eb4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434217:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434223:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434247:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434252:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.434254:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434260:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434269:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f5a83482300) 00010000:00010000:1.0:1788586997.434272:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.434274:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434280:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fd9f5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434296:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434302:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434308:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434313:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.434316:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434332:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434341:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:1.0:1788586997.434344:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.434347:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434366:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fd9fda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434379:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434385:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434392:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434397:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.434400:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434406:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434472:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5baaa90e00) 00010000:00010000:1.0:1788586997.434476:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.434479:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434492:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fd9ffd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434510:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434515:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434520:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434525:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.434528:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434534:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434542:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586997.434556:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.434560:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434566:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda0cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434577:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434584:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434597:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434602:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.434605:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434612:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434621:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:1.0:1788586997.434624:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788586997.434627:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.434633:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda18c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.436758:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127510656:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788586997.436828:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.437055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.437079:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671744 00000100:00100000:2.0:1788586997.437087:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671744 00010000:00010000:2.0:1788586997.437122:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 12 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.437156:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 74 00000100:00100000:2.0:1788586997.437165:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+12:2409:x1875469110671744:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586997.437178:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586997.437182:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 12 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.437215:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 12 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.437240:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788586997.437244:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788586997.437249:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.437260:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.437281:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586997.437323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+12:2409:x1875469110671744:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 158us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.437331:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 74 00010000:00010000:3.0:1788586997.437985:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fd9f6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108d7 expref: 11 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.438012:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbfb55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127510528:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788586997.438033:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438045:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438053:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438063:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438071:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438091:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788586997.438261:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1875469127510272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6450us (6642us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788586997.438268:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788586997.438287:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127510656 00000100:00100000:3.0:1788586997.438292:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127510656 00000100:00100000:3.0:1788586997.438329:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788586997.438336:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1875469127510656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788586997.438372:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1788586997.438401:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9babf4, atime: 0x6a9babf4, ctime: 0x6a9babf4, blocks: 0x8 00010000:00010000:3.0:1788586997.438407:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438455:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1788586997.438460:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788586997.438465:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438477:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438486:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438493:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.438507:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000020:00080000:0.0:1788586997.439344:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5b8523a000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788586997.439362:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5bbc9ee600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5b8523a840 00000020:00080000:0.0:1788586997.439365:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5bae536b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5a81088000 00000004:00080000:0.0:1788586997.439396:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788586997.439460:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5ba7a59a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788586997.439464:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5b854a9300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5ba7a59900 00000020:00080000:0.0:1788586997.439466:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5b854a9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5bb4eb9000 00000020:00080000:0.0:1788586997.439478:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788586997.439495:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788586997.439552:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788586997.440246:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:11386:x1875469110671616:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 Request processed in 15288us (16197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.440257:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 136 00000100:00080000:0.0:1788586997.442747:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788586997.442803:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a836ded80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788586997.442814:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a836ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127510272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788586997.443055:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3646:x1875469127510656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4717us (6224us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788586997.443065:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788586997.443095:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586997.443102:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443114:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586997.443118:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443129:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443148:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443156:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c426ab22/0xfbc93bbea5fda1b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443179:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586997.443184:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443190:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecca00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586997.443193:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443221:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443231:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443237:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000770aa929/0xfbc93bbea5fda1bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.443250:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586997.443252:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586997.443253:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586997.443341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00010000:00010000:2.0:1788586997.443538:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586997.443653:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110671872 00000100:00100000:3.0:1788586997.443661:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110671872 00000100:00100000:3.0:1788586997.443707:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:3.0:1788586997.443717:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+11:2409:x1875469110671872:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788586997.445290:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788586997.445304:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000004:00080000:1.0:1788586997.445644:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a8364df80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788586997.445654:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127510656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788586997.445960:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110671872:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 Request processed in 2241us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.445970:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:2.0:1788586997.449091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.449185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110672128 00000100:00100000:3.0:1788586997.449197:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110672128 00000100:00100000:3.0:1788586997.449289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:3.0:1788586997.449300:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+16:11386:x1875469110672128:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788586997.449361:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586997.449389:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810971 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.449459:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:3.0:1788586997.449465:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788586997.449495:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.449506:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.449515:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788586997.449725:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcc43435 reply state 00000000f26dad06 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.449738:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.449744:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:3.0:1788586997.449746:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788586997.449749:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788586997.449878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+17:11386:x1875469110672128:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 580us (796us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788586997.449886:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:0.0:1788586997.454098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.454170:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110672256 00000100:00100000:3.0:1788586997.454180:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110672256 00000100:00100000:3.0:1788586997.454261:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:3.0:1788586997.454271:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110672256:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788586997.454450:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788586997.454468:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788586997 -> 1788586996 00002000:00010000:3.0:1788586997.454471:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788586996 00002000:00010000:3.0:1788586997.454473:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788586997 -> 1788586996 00002000:00010000:3.0:1788586997.454475:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788586997.454536:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110672256:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 266us (445us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788586997.454552:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:2.0:1788586997.457219:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586997.457331:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110672512 00000100:00100000:1.0:1788586997.457342:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110672512 00000100:00100000:1.0:1788586997.458719:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 138 00000100:00100000:1.0:1788586997.458731:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+17:11386:x1875469110672512:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788586997.458792:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.458824:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.458835:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.458868:0:13553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.458881:0:13553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 17 pid: 6521 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.458894:0:13553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127510784:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788586997.459043:0:13553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b854fe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.461897:0:13553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127510784:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586997.461938:0:13553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.463834:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.463934:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110672640 00000100:00100000:0.0:1788586997.463944:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110672640 00010000:00010000:0.0:1788586997.463983:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 18 pid: 6521 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.464059:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 75 00000100:00100000:0.0:1788586997.464069:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110672640:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586997.464084:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586997.464090:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 18 pid: 6521 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.464103:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 18 pid: 6521 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.464125:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810963 expref: 18 pid: 6521 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.464142:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:0.0:1788586997.464146:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.464155:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.464163:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.464195:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586997.464256:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+17:2409:x1875469110672640:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 188us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.464263:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 75 00010000:00010000:1.0:1788586997.465169:0:13553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465179:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465219:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465227:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465245:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465252:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.465256:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465264:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465278:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:1.0:1788586997.465281:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788586997.465285:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.465292:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.465372:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+16:11386:x1875469110672512:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 Request processed in 6639us (8158us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788586997.465380:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 138 00000100:00100000:2.0:1788586997.468813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.468937:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110672768 00000100:00100000:0.0:1788586997.468953:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110672768 00000100:00100000:0.0:1788586997.469011:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:0.0:1788586997.469022:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110672768:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788586997.469066:0:10047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.469087:0:10047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 7 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.469095:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788586997.469099:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788586997.469103:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.469135:0:10047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 7 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.469149:0:10047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 7 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.469162:0:10047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10047:1875469127510912:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586997.469234:0:10047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.471679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.471764:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110672896 00000100:00100000:3.0:1788586997.471773:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110672896 00010000:00010000:3.0:1788586997.471810:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 8 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.471853:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 76 00000100:00100000:3.0:1788586997.471863:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110672896:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586997.471875:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586997.471895:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 8 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.471908:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 8 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.471944:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788586997.471949:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788586997.471955:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.471965:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.472007:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586997.472064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110672896:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 203us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.472072:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 76 00010000:00010000:0.0:1788586997.475181:0:10047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fda1af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81097f expref: 7 pid: 10047 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.475206:0:10047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10047:1875469127510912:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586997.475246:0:10047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475258:0:10047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475264:0:10047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475292:0:10047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475301:0:10047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475309:0:10047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475315:0:10047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788586997.475320:0:10047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475328:0:10047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475347:0:10047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.475361:0:10047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fda1d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.475484:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110672768:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 Request processed in 6464us (6679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586997.475494:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:2.0:1788586997.478516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.478618:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110673152 00000100:00100000:0.0:1788586997.478627:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110673152 00000100:00100000:0.0:1788586997.478677:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 139 00000100:00100000:0.0:1788586997.478687:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:11386:x1875469110673152:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788586997.478785:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.478798:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.478804:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.478831:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.478841:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 16 pid: 6522 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.478854:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127511040:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586997.479104:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.481547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.481654:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127511040:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586997.481679:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.481788:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110673280 00000100:00100000:3.0:1788586997.481794:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110673280 00010000:00010000:3.0:1788586997.481832:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 17 pid: 6522 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.481908:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:3.0:1788586997.481918:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+17:2409:x1875469110673280:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586997.481931:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586997.481938:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 17 pid: 6522 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.481950:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 17 pid: 6522 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.481970:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda0c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81092b expref: 17 pid: 6522 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.482217:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:3.0:1788586997.482224:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.482236:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.482258:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.482267:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.482298:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586997.482343:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:2409:x1875469110673280:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 425us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.482359:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 77 00010000:00010000:0.0:1788586997.482670:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.482679:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.482833:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.482853:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 16 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.482862:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.482892:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 16 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.482905:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 16 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586997.482917:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127511168:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788586997.482979:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b98747a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.488155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586997.488324:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127511168:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788586997.488376:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.488579:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110673408 00000100:00100000:3.0:1788586997.488587:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110673408 00010000:00010000:3.0:1788586997.488623:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 17 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586997.488663:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:3.0:1788586997.488673:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+17:2408:x1875469110673408:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788586997.488686:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586997.488693:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 17 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.488705:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 17 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.488726:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda193 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c81096a expref: 17 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.488754:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:3.0:1788586997.488759:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.488769:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.488776:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.488794:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586997.488858:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+16:2408:x1875469110673408:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 186us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.488865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 78 00010000:00010000:0.0:1788586997.488919:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586997.488927:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788586997.489037:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788586997.489165:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788586997.489309:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788586997.489388:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127511296:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788586997.489486:0:10048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586997.489515:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9869ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586997.489805:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127511296 00000100:00100000:3.0:1788586997.489868:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127511296 00000100:00100000:2.0:1788586997.490023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788586997.490034:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10048:x1875469127511296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788586997.490121:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10048:x1875469127511296:12345-0@lo:1000:mdt00_003.0 Request processed in 90us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.490128:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788586997.490206:0:10048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788586997.490212:0:10048:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1788586997.490229:0:10048:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a836dc380, transno 4294967310 00000004:00080000:0.0:1788586997.490279:0:10048:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a836ded80, transno 4294967311 00000100:00100000:0.0:1788586997.490805:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127511296:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788586997.491035:0:10048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788586997.491091:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127511424:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788586997.491134:0:10048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586997.491663:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b98747a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586997.491705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127511424 00000100:00100000:3.0:1788586997.491712:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127511424 00000100:00100000:3.0:1788586997.491790:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788586997.491800:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10048:x1875469127511424:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788586997.491939:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10048:x1875469127511424:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (804us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788586997.491948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788586997.492021:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10048:1875469127511424:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788586997.492058:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492067:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492073:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492078:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586997.492083:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492090:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492104:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:2.0:1788586997.492107:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586997.492112:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492137:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda1e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492161:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492167:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492172:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492177:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586997.492180:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492185:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492205:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586997.492207:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788586997.492213:0:10048:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492223:0:10048:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492231:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.492271:0:10048:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.492282:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83784380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127511552:192.168.203.1@tcp:105: 00000100:00100000:2.0:1788586997.492348:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586997.494714:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83784380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127511552:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788586997.494743:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494753:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda123 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494782:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494795:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494806:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494827:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494834:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494841:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494863:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586997.494867:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494874:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494885:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586997.494888:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788586997.494892:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494898:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda1e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494908:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494914:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494920:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494925:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586997.494928:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494933:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494952:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586997.494954:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788586997.494957:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.494963:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda1d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.495121:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+19:11386:x1875469110673152:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 16434us (16612us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788586997.495131:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 139 00000020:00080000:2.0:1788586997.495137:0:10048:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788586997.495895:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586997.495901:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788586997.496318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586997.496387:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110673536 00000100:00100000:1.0:1788586997.496394:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110673536 00000100:00100000:1.0:1788586997.496467:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:1.0:1788586997.496477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+19:11385:x1875469110673536:12345-192.168.203.1@tcp:49:lfs.0 00000100:00100000:1.0:1788586997.496638:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+19:11385:x1875469110673536:12345-192.168.203.1@tcp:49:lfs.0 Request processed in 162us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.496651:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 31 00000040:00080000:3.0:1788586997.498021:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788586997.498037:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788586997.499370:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.499479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110673792 00000100:00100000:3.0:1788586997.499606:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110673792 00000100:00100000:2.0:1788586997.499685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.499771:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 140 00000100:00100000:2.0:1788586997.499780:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+19:11385:x1875469110673792:12345-192.168.203.1@tcp:58:lfs.0 00000100:00100000:1.0:1788586997.499822:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110674048 00000100:00100000:1.0:1788586997.499828:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110674048 00000100:00100000:1.0:1788586997.499864:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:1.0:1788586997.499872:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+20:11386:x1875469110674048:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1788586997.500066:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000004:00080000:1.0:1788586997.500257:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788586997.500287:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788586997.500321:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.500336:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.500347:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.500460:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+22:11385:x1875469110673792:12345-192.168.203.1@tcp:58:lfs.0 Request processed in 679us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.500468:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 140 00010000:00010000:1.0:1788586997.500531:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.500537:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.501042:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.501065:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788586997.501469:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586997.501476:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.501483:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788586997.501488:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.501497:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.501512:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:3.0:1788586997.501515:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788586997.501520:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.501526:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586997.501538:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586997.501540:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586997.501542:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586997.501595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+21:11386:x1875469110674048:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 1722us (1907us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788586997.501604:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 32 00000020:00080000:1.0:1788586997.501622:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788586997.534237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586997.534495:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110674176 00000100:00100000:1.0:1788586997.534506:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110674176 00000100:00100000:1.0:1788586997.534574:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 141 00000100:00100000:1.0:1788586997.534595:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+21:11388:x1875469110674176:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788586997.534618:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586997.534638:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810986 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534699:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534713:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534725:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534740:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534747:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534753:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534835:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534847:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534874:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534907:0:13553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.534919:0:13553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 22 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586997.534933:0:13553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127511680:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788586997.535039:0:13553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba7a59900 going to sleep for 11 seconds 00000100:00100000:1.0:1788586997.538621:0:13553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127511680:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788586997.538652:0:13553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.539323:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586997.539635:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110674432 00000100:00100000:3.0:1788586997.539645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110674432 00000100:00100000:3.0:1788586997.539706:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:3.0:1788586997.539717:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+23:6175:x1875469110674432:12345-192.168.203.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788586997.540118:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+24:6175:x1875469110674432:12345-192.168.203.1@tcp:35:ldlm_bl.0 Request processed in 400us (795us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788586997.540126:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:0.0:1788586997.545007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586997.545156:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110674560 00000100:00100000:2.0:1788586997.545166:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110674560 00010000:00010000:2.0:1788586997.545225:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 24 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586997.545285:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 79 00000100:00100000:2.0:1788586997.545296:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+24:2408:x1875469110674560:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788586997.545313:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586997.545319:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 24 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.545333:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 24 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.545356:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda115 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810947 expref: 24 pid: 13553 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.545372:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586997.545377:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.545386:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.545395:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586997.545485:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586997.545536:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+23:2408:x1875469110674560:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 241us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.545543:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 79 00010000:00010000:1.0:1788586997.545717:0:13553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545726:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788586997.545778:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788586997.545783:0:13553:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788586997.545803:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545827:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545851:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545857:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545864:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545869:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.545873:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545880:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.545890:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788586997.546025:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.546031:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546038:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda1fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546052:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546058:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546064:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546076:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788586997.546080:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546087:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546096:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f5a83482300) 00010000:00010000:1.0:1788586997.546098:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788586997.546101:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546107:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546143:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda1f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810986 expref: 23 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546157:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810986 expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586997.546164:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788586997.546166:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788586997.546169:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466e00, rc 0) 00000100:00100000:1.0:1788586997.546216:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+22:11388:x1875469110674176:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 11633us (11990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586997.546224:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 141 00000100:00100000:1.0:1788586997.588726:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586997.588765:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127511808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788586997.588848:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586997.589088:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127511808 00000100:00100000:3.0:1788586997.589097:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127511808 00000100:00100000:3.0:1788586997.589150:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788586997.589160:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127511808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788586997.589206:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788586997.589255:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127511808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586997.589263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788586997.589503:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127511808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788586998.100636:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127512064:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.100705:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.100752:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbfb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127512576:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.100775:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.100792:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127513088:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.100813:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.100844:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788586998.100850:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127511936:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.100878:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.100900:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127512448:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.100925:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.100939:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127512960:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.100960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.100978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127513472:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.101000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586998.101487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512064 00000100:00100000:3.0:1788586998.101495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512064 00000100:00100000:3.0:1788586998.101539:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512576 00000100:00100000:3.0:1788586998.101541:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512576 00000100:00100000:3.0:1788586998.101562:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513088 00000100:00100000:3.0:1788586998.101564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513088 00000100:00100000:3.0:1788586998.101578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788586998.101586:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127512064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.101874:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127512064:12345-0@lo:400:kworker.0 Request processed in 288us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586998.101881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788586998.101898:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788586998.101904:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.101929:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127512576:12345-0@lo:400:kworker.0 Request processed in 27us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586998.101935:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788586998.101943:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788586998.101948:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.101973:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127513088:12345-0@lo:400:kworker.0 Request processed in 25us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586998.101979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788586998.101997:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512448 00000100:00100000:3.0:1788586998.102011:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512448 00000100:00100000:3.0:1788586998.102052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788586998.102058:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127512448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.102826:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127512192:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.102865:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.102888:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbfb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127512704:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.102904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.102918:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127513216:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.102933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.102955:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788586998.102961:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127512320:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.102979:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.102987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127512832:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103006:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.103032:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127513344:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103049:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586998.103169:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512704 00000100:00100000:1.0:1788586998.103174:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512704 00000100:00100000:1.0:1788586998.103199:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513216 00000100:00100000:1.0:1788586998.103201:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513216 00000100:00100000:1.0:1788586998.103211:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512320 00000100:00100000:1.0:1788586998.103213:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512320 00000100:00100000:1.0:1788586998.103223:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788586998.103229:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127512704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103266:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127512704:12345-0@lo:400:kworker.0 Request processed in 37us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103272:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788586998.103287:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788586998.103291:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127513216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103311:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127513216:12345-0@lo:400:kworker.0 Request processed in 19us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103316:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788586998.103324:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788586998.103328:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127512320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103346:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127512320:12345-0@lo:400:kworker.0 Request processed in 18us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103360:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788586998.103375:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127511936 00000100:00100000:1.0:1788586998.103379:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127511936 00000100:00100000:1.0:1788586998.103398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788586998.103404:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127511936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127511936:12345-0@lo:400:kworker.0 Request processed in 54us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103463:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788586998.103487:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512960 00000100:00100000:1.0:1788586998.103489:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512960 00000100:00100000:1.0:1788586998.103503:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513472 00000100:00100000:1.0:1788586998.103505:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513472 00000100:00100000:1.0:1788586998.103513:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512832 00000100:00100000:1.0:1788586998.103515:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512832 00000100:00100000:1.0:1788586998.103525:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513344 00000100:00100000:1.0:1788586998.103527:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513344 00000100:00100000:1.0:1788586998.103537:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788586998.103542:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1875469127512960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103566:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3649:x1875469127512960:12345-0@lo:400:kworker.0 Request processed in 24us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103572:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788586998.103580:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586998.103585:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5baf360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127513472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103608:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5baf360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127513472:12345-0@lo:400:kworker.0 Request processed in 23us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103614:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586998.103739:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788586998.103751:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127512832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103780:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127512832:12345-0@lo:400:kworker.0 Request processed in 30us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103785:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788586998.103795:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788586998.103800:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127513344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103819:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127513344:12345-0@lo:400:kworker.0 Request processed in 19us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103824:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788586998.103839:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127512192 00000100:00100000:1.0:1788586998.103842:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127512192 00000100:00100000:1.0:1788586998.103856:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788586998.103861:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127512192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103884:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127512192:12345-0@lo:400:kworker.0 Request processed in 23us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.103889:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788586998.103925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127512320:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103934:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127512832:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103942:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127513344:0@lo:400:kworker.0 00000100:00100000:1.0:1788586998.103949:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127512192:0@lo:400:kworker.0 00010000:00080000:1.0:1788586998.103959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbfb55180 x1875469127512704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586998.103969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbfb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127512704:0@lo:400:kworker.0 00010000:00080000:1.0:1788586998.103985:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83f99180 x1875469127513216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586998.103993:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127513216:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104170:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127512448:12345-0@lo:400:kworker.0 Request processed in 2112us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586998.104177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1788586998.104201:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586998.104205:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586998.104207:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788586998.104209:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788586998.104233:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127511936:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104243:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127512448:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104254:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127512960:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104263:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127513472:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104272:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127512064:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbfb56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127512576:0@lo:400:kworker.0 00000100:00100000:3.0:1788586998.104291:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127513088:0@lo:400:kworker.0 00000040:00080000:3.0:1788586998.186298:0:14257:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586998.186305:0:14257:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788586998.186341:0:14257:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788586998.186348:0:14257:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788586998.230677:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788586998.549792:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788586998.549801:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788586998.549825:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788586998.549851:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788586998.550106:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127513600:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788586998.550221:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b811cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586998.553943:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127513600:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788586998.557307:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586998.557724:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110674688 00000100:00100000:1.0:1788586998.557734:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110674688 00000100:00100000:1.0:1788586998.557814:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 142 00000100:00100000:1.0:1788586998.557825:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+22:11400:x1875469110674688:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788586998.557862:0:10048:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788586998.558007:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+22:11400:x1875469110674688:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 183us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586998.558014:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 142 00000100:00080000:3.0:1788586998.558392:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586998.563571:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586998.563659:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110674944 00000100:00100000:3.0:1788586998.563670:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110674944 00000100:00100000:3.0:1788586998.563738:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 143 00000100:00100000:3.0:1788586998.563750:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+22:11400:x1875469110674944:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788586998.563772:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586998.563794:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda211 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81098d expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.564023:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda218 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.564039:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.564051:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda218 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788586998.564214:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788586998.564399:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda211 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81098d expref: 25 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.564465:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda218 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81098d expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.564493:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:3.0:1788586998.564496:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788586998.564500:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecce00, rc 0) 00000100:00100000:3.0:1788586998.564608:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+24:11400:x1875469110674944:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 859us (1045us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788586998.564616:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 143 00000100:00100000:0.0:1788586998.573174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788586998.573272:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110675200 00000100:00100000:3.0:1788586998.573352:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110675200 00000100:00100000:3.0:1788586998.573411:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 144 00000100:00100000:3.0:1788586998.573462:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+24:11400:x1875469110675200:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788586998.573544:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573561:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573572:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573716:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573724:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573731:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573752:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecca00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788586998.573757:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573764:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573775:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:3.0:1788586998.573778:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788586998.573783:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586998.573789:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda226 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586998.573901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+25:11400:x1875469110675200:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 446us (736us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788586998.573909:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 144 00000040:00080000:0.0:1788586998.574475:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788586998.574481:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788586998.574974:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788586998.574986:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788586998.575227:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788586998.575608:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110675328 00000100:00100000:0.0:1788586998.575617:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110675328 00000100:00100000:0.0:1788586998.575673:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:0.0:1788586998.575682:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+25:2408:x1875469110675328:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788586998.575695:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586998.575715:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81098d expref: 25 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586998.575733:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:0.0:1788586998.575737:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586998.575785:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+24:2408:x1875469110675328:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 104us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586998.575792:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:2.0:1788586998.578792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788586998.578868:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110675584 00000100:00100000:1.0:1788586998.578877:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110675584 00000100:00100000:1.0:1788586998.578931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:1.0:1788586998.578941:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+24:11400:x1875469110675584:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788586998.579162:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+25:11400:x1875469110675584:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 222us (377us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788586998.579170:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 34 00000001:00080000:1.0:1788586999.128245:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788586999.128261:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:2.0:1788586999.252616:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788586999.802996:0:14310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788586999.803004:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788586999.803103:0:14310:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788586999.803111:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788586999.905806:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586999.905987:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110675840 00000100:00100000:2.0:1788586999.905997:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110675840 00000100:00100000:2.0:1788586999.906063:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 145 00000100:00100000:2.0:1788586999.906074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+25:11420:x1875469110675840:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788586999.906100:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586999.906121:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda22d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810994 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.906762:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda234 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.906779:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.906792:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda234 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788586999.907043:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788586999.907157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda22d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810994 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.907176:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda234 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810994 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.907185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586999.907188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788586999.907199:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71e00, rc 0) 00000100:00100000:2.0:1788586999.907815:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+27:11420:x1875469110675840:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1739us (2014us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788586999.908013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 145 00000100:00100000:3.0:1788586999.912641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788586999.912784:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110675968 00000100:00100000:2.0:1788586999.912795:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110675968 00000100:00100000:2.0:1788586999.912869:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 146 00000100:00100000:2.0:1788586999.912880:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+27:11420:x1875469110675968:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:2.0:1788586999.912957:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.912975:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.912989:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913021:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913030:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913037:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913044:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788586999.913049:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913057:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913081:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:2.0:1788586999.913084:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788586999.913090:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586999.913097:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586999.913165:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+27:11420:x1875469110675968:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 286us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586999.913173:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 146 00000100:00100000:0.0:1788587000.005895:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587000.006036:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676096 00000100:00100000:1.0:1788587000.006046:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676096 00000100:00100000:1.0:1788587000.006123:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:1.0:1788587000.006135:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba0528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110676096:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:1.0:1788587000.006166:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587000.006193:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061099146/0xfbc93bbea5fda249 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c81099b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587000.006215:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9babf4, atime: 0x6a9babf4, ctime: 0x6a9babf4, blocks: 0x8 00010000:00010000:1.0:1788587000.006235:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788587000.006238:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587000.006248:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061099146/0xfbc93bbea5fda249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81099b expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.006266:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061099146/0xfbc93bbea5fda249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81099b expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587000.006279:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467c00, rc 0) 00000100:00100000:1.0:1788587000.006347:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba0528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110676096:12345-192.168.203.1@tcp:101:cat.0 Request processed in 215us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587000.006354:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00080000:3.0:1788587000.007782:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587000.015011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587000.015232:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676224 00000100:00100000:0.0:1788587000.015242:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676224 00002000:00100000:0.0:1788587000.015294:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8f5a83786300 x1875469110676224/t0(0) o3->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:316/0 lens 488/0 e 0 to 0 dl 1788587011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587000.015305:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83786300 with x1875469110676224 ext(0->4095) 00002000:00010000:0.0:1788587000.015310:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83786300 00000100:00100000:0.0:1788587000.015344:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:0.0:1788587000.015368:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110676224:12345-192.168.203.1@tcp:3:cat.0 00000100:00100000:0.0:1788587000.015827:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110676224:12345-192.168.203.1@tcp:3:cat.0 Request processed in 458us (824us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788587000.015835:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 3 00002000:00100000:0.0:1788587000.015842:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8f5a83786300 x1875469110676224/t0(0) o3->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:316/0 lens 488/4536 e 0 to 0 dl 1788587011 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587000.015850:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83786300 with x1875469110676224 ext(0->4095) 00002000:00010000:0.0:1788587000.015854:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83786300 00000100:00100000:0.0:1788587000.148802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127513856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587000.148886:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587000.149064:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513856 00000100:00100000:3.0:1788587000.149073:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513856 00000100:00100000:3.0:1788587000.149138:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788587000.149149:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127513856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587000.149178:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788587000.149239:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127513856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587000.149246:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788587000.149309:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127513856:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788587000.149487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587000.149607:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127513728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587000.149643:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587000.149731:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513728 00000100:00100000:1.0:1788587000.149736:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513728 00000100:00100000:1.0:1788587000.149781:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788587000.149790:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127513728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587000.149802:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788587000.150002:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127513728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587000.150010:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788587000.150624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587000.152068:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127513728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587000.277827:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587000.426212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587000.426298:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587000.426335:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587000.426373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587000.426393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587000.426466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676480 00000100:00100000:0.0:1788587000.426467:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587000.426478:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676480 00000100:00100000:0.0:1788587000.426500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587000.426536:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676608 00000100:00100000:0.0:1788587000.426541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676608 00000100:00100000:2.0:1788587000.426546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110677120 00000100:00100000:2.0:1788587000.426552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110677120 00000100:00100000:0.0:1788587000.426574:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676992 00000100:00100000:0.0:1788587000.426579:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676992 00000100:00100000:2.0:1788587000.426583:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 257 00000100:00100000:0.0:1788587000.426816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 258 00000100:00100000:0.0:1788587000.426824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110676608:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587000.426964:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110676608:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 72us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587000.426989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 258 00000100:00100000:0.0:1788587000.427007:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 259 00000100:00100000:0.0:1788587000.427013:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110677120:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587000.427039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110677120:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587000.427045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 259 00000100:00100000:0.0:1788587000.427056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 260 00000100:00100000:1.0:1788587000.427204:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676864 00000100:00100000:1.0:1788587000.427216:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676864 00000100:00100000:1.0:1788587000.427242:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676736 00000100:00100000:1.0:1788587000.427245:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676736 00000100:00100000:1.0:1788587000.427268:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 110 00000100:00100000:1.0:1788587000.427275:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110676864:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587000.427302:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110676864:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587000.427307:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 110 00000100:00100000:1.0:1788587000.427321:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 111 00000100:00100000:1.0:1788587000.427326:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110676736:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587000.427347:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110676736:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 21us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587000.427352:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 111 00000100:00080000:1.0:1788587000.427556:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587000.427561:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587000.427563:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587000.429750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110676352 00000100:00100000:3.0:1788587000.429765:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110676352 00000100:00100000:3.0:1788587000.429826:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 376 00000100:00100000:3.0:1788587000.429835:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110676352:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587000.430057:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110676352:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 222us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587000.430065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 376 00000100:00100000:2.0:1788587000.430329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+27:2408:x1875469110676480:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587000.430380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+27:2408:x1875469110676480:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 3788us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587000.430388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 257 00000100:00100000:0.0:1788587000.431049:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110676992:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587000.431091:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110676992:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 4029us (4591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587000.431099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 260 00000100:00100000:2.0:1788587001.172903:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127513984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587001.172975:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587001.173141:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127513984 00000100:00100000:1.0:1788587001.173151:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127513984 00000100:00100000:1.0:1788587001.173218:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587001.173227:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127513984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587001.173253:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788587001.173304:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127513984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587001.173311:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788587001.173365:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587001.173396:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788587001.173401:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1788587001.173472:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a83606680, transno 4294967302 00000004:00080000:2.0:1788587001.173481:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788587001.173490:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a8364df80, transno 4294967305 00000100:00100000:2.0:1788587001.173501:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127513984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587001.176083:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127514112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587001.176157:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587001.176240:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514112 00000100:00100000:2.0:1788587001.176248:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514112 00000100:00100000:2.0:1788587001.176323:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587001.176333:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127514112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587001.176377:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788587001.176466:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127514112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587001.176475:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587001.176534:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127514112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587001.176791:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587001.176802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127514240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587001.176838:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587001.176918:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514240 00000100:00100000:1.0:1788587001.176927:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514240 00000100:00100000:1.0:1788587001.176979:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587001.176999:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127514240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587001.177014:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788587001.177054:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127514240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587001.177061:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587001.177109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127514240:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788587001.177160:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587001.302632:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587002.327579:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587002.709796:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587002.709822:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127514368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587002.709894:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587002.709948:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514368 00000100:00100000:3.0:1788587002.709958:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514368 00000100:00100000:3.0:1788587002.710008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788587002.710017:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127514368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587002.710048:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788587002.710117:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127514368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587002.710124:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788587002.710186:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127514368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587003.220735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127514880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.220807:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.220858:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127515392:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.220904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.220920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127515904:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.220939:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.220961:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788587003.220967:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127514496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.220993:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.221014:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127515008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.221037:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587003.221716:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515392 00000100:00100000:0.0:1788587003.221724:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515392 00000100:00100000:0.0:1788587003.221773:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515904 00000100:00100000:0.0:1788587003.221776:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515904 00000100:00100000:0.0:1788587003.221797:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788587003.221806:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a827a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127515392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.221860:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a827a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127515392:12345-0@lo:400:kworker.0 Request processed in 56us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.221875:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788587003.221903:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587003.221909:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.221935:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127515904:12345-0@lo:400:kworker.0 Request processed in 27us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.221940:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587003.221957:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514880 00000100:00100000:0.0:1788587003.221960:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514880 00000100:00100000:0.0:1788587003.221984:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788587003.221990:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127514880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222017:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127514880:12345-0@lo:400:kworker.0 Request processed in 28us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.222022:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788587003.222039:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127514624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222065:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587003.222083:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127515136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587003.222112:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127515648:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222128:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587003.222143:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788587003.222148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127514752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222167:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587003.222181:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127515264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222198:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587003.222220:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127515776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.222240:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788587003.222257:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587003.222261:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587003.222316:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127515520:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.222342:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.226299:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.226375:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587003.227084:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127514880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.227101:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127515392:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.227112:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127515904:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.227156:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515008 00000100:00100000:3.0:1788587003.227163:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515008 00000100:00100000:3.0:1788587003.227219:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514752 00000100:00100000:3.0:1788587003.227222:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514752 00000100:00100000:3.0:1788587003.227239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587003.227247:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127515008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.227546:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127515008:12345-0@lo:400:kworker.0 Request processed in 299us (6507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587003.227555:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587003.227601:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587003.227607:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127514752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.227647:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a834a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127514752:12345-0@lo:400:kworker.0 Request processed in 40us (5478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587003.227653:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788587003.227800:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515520 00000100:00100000:1.0:1788587003.227806:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515520 00000100:00100000:1.0:1788587003.227846:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516032 00000100:00100000:1.0:1788587003.227848:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516032 00000100:00100000:1.0:1788587003.227862:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788587003.227869:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127515520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587003.227982:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127515520:12345-0@lo:400:kworker.0 Request processed in 113us (5639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.227989:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788587003.228001:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788587003.228006:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127516032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587003.228033:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127516032:12345-0@lo:400:kworker.0 Request processed in 27us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.228040:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788587003.228120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514496 00000100:00100000:1.0:1788587003.228124:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514496 00000100:00100000:1.0:1788587003.228153:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788587003.228160:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127514496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587003.228192:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127514496:12345-0@lo:400:kworker.0 Request processed in 33us (7198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587003.229813:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127514496:0@lo:400:kworker.0 00000100:00100000:2.0:1788587003.229834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127515008:0@lo:400:kworker.0 00000100:00100000:2.0:1788587003.229848:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127515520:0@lo:400:kworker.0 00000100:00100000:2.0:1788587003.229861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.230775:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127514752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587003.230839:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127514624 00000100:00100000:3.0:1788587003.230845:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127514624 00000100:00100000:1.0:1788587003.231481:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:1.0:1788587003.231555:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587003.231560:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587003.231691:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515136 00000100:00100000:0.0:1788587003.231697:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515136 00000100:00080000:1.0:1788587003.231907:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587003.232023:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515648 00000100:00100000:1.0:1788587003.232028:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515648 00000100:00100000:3.0:1788587003.232176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515264 00000100:00100000:3.0:1788587003.232180:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515264 00000100:00100000:0.0:1788587003.232623:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127515776 00000100:00100000:0.0:1788587003.232628:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127515776 00000100:00100000:0.0:1788587003.232653:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788587003.232660:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127514624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.232742:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127514624:12345-0@lo:400:kworker.0 Request processed in 81us (10674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.232749:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788587003.232788:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127514624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.232815:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788587003.232822:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a836ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127515136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788587003.232835:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587003.232839:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587003.232854:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a836ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127515136:12345-0@lo:400:kworker.0 Request processed in 33us (10754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.232860:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788587003.232896:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127515136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.232917:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788587003.232923:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127515776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.232962:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127515776:12345-0@lo:400:kworker.0 Request processed in 40us (10721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.232968:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00080000:2.0:1788587003.234021:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83773100 x1875469127515776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587003.234043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127515776:0@lo:400:kworker.0 00000001:00080000:0.0:1788587003.234148:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1788587003.234184:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5b9869a9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788587003.234188:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5b854a9500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5b9869ae40 00000020:00080000:0.0:1788587003.234192:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5b854a9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5bc205f000 00000020:00080000:0.0:1788587003.234227:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788587003.234239:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788587003.234299:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788587003.234726:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.234737:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.234744:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.234750:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecde00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587003.234755:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.234763:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.234782:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f5baaa90300) 00010000:00010000:2.0:1788587003.234785:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587003.234790:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587003.234816:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda1c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587003.235103:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788587003.235111:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:1.0:1788587003.238893:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788587003.238917:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127515648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587003.239021:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127515648:12345-0@lo:400:kworker.0 Request processed in 116us (16891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.239029:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788587003.239219:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127515648:0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.240347:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788587003.240381:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127515264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587003.240487:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127515264:12345-0@lo:400:kworker.0 Request processed in 129us (18287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.240495:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:2.0:1788587003.240624:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8364df80 x1875469127515264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587003.240639:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127515264:0@lo:400:kworker.0 00010000:00010000:3.0:1788587003.350999:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587004.026253:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587004.026365:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110677248 00000100:00100000:0.0:1788587004.026375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110677248 00000100:00100000:0.0:1788587004.026488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 147 00000100:00100000:0.0:1788587004.026500:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+13:11074:x1875469110677248:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788587004.026743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+13:11074:x1875469110677248:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 Request processed in 244us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587004.026752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 147 00000100:00080000:2.0:1788587004.026849:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587004.028630:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587004.028851:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110677376 00000100:00100000:1.0:1788587004.028860:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110677376 00000100:00080000:2.0:1788587004.029521:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587004.029660:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 148 00000100:00100000:1.0:1788587004.029675:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:11074:x1875469110677376:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788587004.029804:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:11074:x1875469110677376:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 Request processed in 131us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587004.032150:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 148 00000100:00100000:3.0:1788587004.032497:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587004.032661:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110677632 00000100:00100000:1.0:1788587004.032669:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110677632 00000100:00100000:1.0:1788587004.032730:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:1.0:1788587004.032741:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+13:11074:x1875469110677632:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788587004.033192:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+14:11074:x1875469110677632:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 452us (694us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788587004.033201:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:3.0:1788587004.255224:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587004.255332:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110677760 00000100:00100000:0.0:1788587004.255342:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110677760 00000100:00100000:0.0:1788587004.255470:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 149 00000100:00100000:0.0:1788587004.255481:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:11880:x1875469110677760:12345-192.168.203.1@tcp:101:lsof.0 00010000:00010000:0.0:1788587004.255510:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587004.255530:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109a2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587004.255625:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587004.255640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587004.255653:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587004.255699:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788587004.255703:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587004.255742:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587004.255765:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587004.255782:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587004.255790:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:0.0:1788587004.255793:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587004.255797:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788587004.255842:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:11880:x1875469110677760:12345-192.168.203.1@tcp:101:lsof.0 Request processed in 363us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587004.255849:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 149 00000100:00080000:2.0:1788587004.256092:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587004.374286:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587005.268785:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587005.268825:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127516160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587005.268896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587005.269156:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516160 00000100:00100000:3.0:1788587005.269164:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516160 00000100:00100000:3.0:1788587005.269232:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788587005.269251:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127516160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587005.269279:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788587005.269325:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127516160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587005.269332:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788587005.269549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127516160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587005.269869:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbfb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127516288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587005.269907:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587005.269986:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587005.270994:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516288 00000100:00100000:0.0:1788587005.271004:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516288 00000100:00100000:0.0:1788587005.271792:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587005.271801:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127516288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587005.271822:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788587005.271892:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127516288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587005.271899:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788587005.271989:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788587005.271995:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788587005.272047:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbfb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127516288:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788587005.272235:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788587005.396910:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587005.544783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545089:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545151:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545201:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587005.545247:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678400 00000100:00100000:3.0:1788587005.545255:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678400 00000100:00100000:3.0:1788587005.545308:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678272 00000100:00100000:3.0:1788587005.545311:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678272 00000100:00100000:3.0:1788587005.545330:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 116 00000100:00100000:3.0:1788587005.545339:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110678400:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587005.545441:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110678400:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587005.545448:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 116 00000100:00100000:3.0:1788587005.545465:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00100000:3.0:1788587005.545472:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110678272:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587005.545495:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110678272:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587005.545501:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00080000:3.0:1788587005.545515:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587005.545519:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587005.545597:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678144 00000100:00100000:3.0:1788587005.545601:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678144 00000100:00100000:1.0:1788587005.546524:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110677888 00000100:00100000:1.0:1788587005.546533:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110677888 00000100:00100000:1.0:1788587005.546671:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 378 00000100:00100000:1.0:1788587005.546679:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110677888:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587005.546734:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110677888:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 55us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587005.546741:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 378 00000100:00100000:3.0:1788587005.546992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678656 00000100:00100000:3.0:1788587005.546997:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678656 00000100:00080000:2.0:1788587005.547221:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587005.549029:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678016 00000100:00100000:1.0:1788587005.549042:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678016 00000100:00100000:1.0:1788587005.549085:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678528 00000100:00100000:1.0:1788587005.549088:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678528 00000100:00100000:1.0:1788587005.549109:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 267 00000100:00100000:1.0:1788587005.549119:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110678144:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587005.549206:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110678144:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 88us (4117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587005.549213:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 267 00000100:00100000:1.0:1788587005.549231:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 268 00000100:00100000:1.0:1788587005.549237:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110678656:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587005.549260:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110678656:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 24us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587005.549265:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 268 00000100:00100000:1.0:1788587005.549276:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 269 00000100:00100000:1.0:1788587005.549282:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:2408:x1875469110678016:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587005.549309:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:2408:x1875469110678016:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 27us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587005.549331:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 269 00000100:00100000:1.0:1788587005.549344:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 270 00000100:00100000:1.0:1788587005.549350:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2408:x1875469110678528:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587005.549373:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2408:x1875469110678528:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 23us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587005.549391:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 270 00000100:00100000:3.0:1788587006.292714:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587006.292740:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127516416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587006.292816:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.292974:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587006.292987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587006.293024:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.293031:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127516672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587006.293068:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.293109:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516672 00000100:00100000:2.0:1788587006.293119:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516672 00000100:00100000:0.0:1788587006.293177:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516416 00000100:00100000:2.0:1788587006.293180:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587006.293190:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127516672:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587006.293196:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516416 00000004:00000024:2.0:1788587006.293225:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788587006.293238:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516544 00000100:00100000:0.0:1788587006.293243:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516544 00000100:00100000:0.0:1788587006.293265:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788587006.293274:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127516416:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587006.293280:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127516672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.293289:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00002000:00000024:0.0:1788587006.293299:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788587006.293329:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788587006.293338:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127516544:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587006.293346:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127516416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (529us total) trans 0 rc 0/0 00002000:00000024:2.0:1788587006.293350:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788587006.293356:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788587006.293389:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587006.293455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127516416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587006.293498:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127516544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.293516:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788587006.293647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587006.293751:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127516672:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788587006.357139:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587006.420753:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587006.806258:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587006.806266:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587006.806348:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788587006.806355:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:0.0:1788587007.237498:0:14508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:43:26 (1788587006) 00010000:00010000:3.0:1788587007.446592:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587007.829529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8364dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127516800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587007.829601:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587007.831678:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516800 00000100:00100000:0.0:1788587007.831692:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516800 00000100:00100000:0.0:1788587007.831810:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788587007.831821:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127516800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587007.831856:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788587007.831942:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127516800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587007.831948:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788587007.832040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8364dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127516800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587008.342684:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127516928:0@lo:400:kworker.0 00000100:00100000:0.0:1788587008.342770:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587008.343002:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127516928 00000100:00100000:1.0:1788587008.343030:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127516928 00000100:00100000:1.0:1788587008.343087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788587008.343097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127516928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.343594:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127517056:0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.343633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587008.343702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517056 00000100:00100000:3.0:1788587008.343707:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517056 00000100:00100000:3.0:1788587008.343738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788587008.343745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127517056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.343784:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8364dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127517056:12345-0@lo:400:kworker.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587008.343790:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788587008.343830:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127517056:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.344289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127516928:12345-0@lo:400:kworker.0 Request processed in 1192us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.344297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788587008.344428:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587008.344583:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127516928:0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.344636:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127517312:0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.344683:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587008.344709:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127517184:0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.344730:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587008.344802:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517312 00000100:00100000:1.0:1788587008.344807:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517312 00000100:00100000:1.0:1788587008.344850:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788587008.344857:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127517312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.344900:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127517312:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.344906:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788587008.344933:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127517312:0@lo:400:kworker.0 00000100:00100000:0.0:1788587008.345374:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517184 00000100:00100000:0.0:1788587008.345379:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517184 00000100:00100000:0.0:1788587008.345433:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788587008.345440:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127517184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587008.345572:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127517184:12345-0@lo:400:kworker.0 Request processed in 124us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587008.345578:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587008.345733:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127517184:0@lo:400:kworker.0 00000100:00100000:0.0:1788587008.345926:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127517440:0@lo:400:kworker.0 00000100:00100000:0.0:1788587008.345964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587008.346855:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127517696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.346889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587008.346906:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127518208:0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.346923:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587008.346942:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788587008.346947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127517824:0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.346969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587008.347608:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.347634:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587008.347666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517696 00000100:00100000:2.0:1788587008.347793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517696 00000100:00100000:2.0:1788587008.347845:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127518208 00000100:00100000:2.0:1788587008.347848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127518208 00000100:00100000:2.0:1788587008.347870:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788587008.347879:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127517696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.347930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127517696:12345-0@lo:400:kworker.0 Request processed in 53us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587008.347937:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788587008.347951:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788587008.347957:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127518208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348173:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127517568:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348211:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587008.348233:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127518080:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348253:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587008.348271:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587008.348276:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127517952:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587008.348309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127518464:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348327:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587008.348349:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517824 00000100:00100000:1.0:1788587008.348353:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517824 00000100:00100000:1.0:1788587008.348389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127518336 00000100:00100000:1.0:1788587008.348392:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127518336 00000100:00100000:1.0:1788587008.348402:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517952 00000100:00100000:1.0:1788587008.348404:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517952 00000100:00100000:1.0:1788587008.348436:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127518464 00000100:00100000:1.0:1788587008.348439:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127518464 00000100:00100000:1.0:1788587008.348455:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788587008.348461:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127517824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348491:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127517824:12345-0@lo:400:kworker.0 Request processed in 31us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.348497:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788587008.348508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587008.348514:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348539:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127518336:12345-0@lo:400:kworker.0 Request processed in 26us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.348545:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587008.348554:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587008.348580:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127517952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348612:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127517952:12345-0@lo:400:kworker.0 Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.348618:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587008.348629:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788587008.348634:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127518464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.348657:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127518464:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.348663:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788587008.348832:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127518208:12345-0@lo:400:kworker.0 Request processed in 874us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587008.348839:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788587008.348851:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517568 00000100:00100000:2.0:1788587008.348854:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517568 00000100:00100000:2.0:1788587008.348871:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127518080 00000100:00100000:2.0:1788587008.348874:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127518080 00000100:00100000:2.0:1788587008.348888:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788587008.348894:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.348921:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127517568:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587008.348927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788587008.348937:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788587008.348943:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587008.348965:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127518080:12345-0@lo:400:kworker.0 Request processed in 22us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587008.348971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1788587008.348996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587008.349002:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587008.349004:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587008.349195:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127517952:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.349207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127518464:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.349215:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127517568:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.349223:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127518080:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.349286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba052b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127517824:0@lo:400:kworker.0 00000100:00100000:1.0:1788587008.349295:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbca79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127518336:0@lo:400:kworker.0 00010000:00080000:1.0:1788587008.349308:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83787100 x1875469127517696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587008.349318:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127517696:0@lo:400:kworker.0 00010000:00080000:1.0:1788587008.349327:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a19500 x1875469127518208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587008.349335:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127518208:0@lo:400:kworker.0 00000100:00080000:2.0:1788587008.349491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587008.351234:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127517440 00000100:00100000:3.0:1788587008.351250:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127517440 00000100:00100000:3.0:1788587008.351315:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788587008.351326:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127517440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.351448:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127517440:12345-0@lo:400:kworker.0 Request processed in 124us (5482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587008.351455:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788587008.351930:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127517440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587008.368330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587008.368551:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110678912 00000100:00100000:2.0:1788587008.368562:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110678912 00000100:00100000:2.0:1788587008.368826:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 150 00000100:00100000:2.0:1788587008.368837:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+14:12146:x1875469110678912:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587008.368858:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587008.368880:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda25e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.368983:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.368999:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369027:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369043:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369050:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369156:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda273 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369165:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369172:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587008.369181:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788587008.369485:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369494:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369509:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369515:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587008.369519:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369527:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369540:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:2.0:1788587008.369543:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587008.369548:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369555:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda265 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369580:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369587:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369593:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369599:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587008.369602:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369619:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369628:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f5a834bb200) 00010000:00010000:2.0:1788587008.369631:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587008.369634:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.369640:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda26c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.370227:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda25e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a9 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.370247:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda273 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a9 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587008.370255:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:2.0:1788587008.370257:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587008.370260:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70000, rc 0) 00000100:00080000:0.0:1788587008.370425:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587008.370501:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+16:12146:x1875469110678912:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 1665us (2179us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788587008.370510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 150 00000001:00080000:2.0:1788587008.373950:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1788587008.373969:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788587008.374266:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788587008.374280:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788587008.383384:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587008.383888:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679040 00000100:00100000:2.0:1788587008.383899:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679040 00000100:00100000:2.0:1788587008.384220:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 151 00000100:00100000:2.0:1788587008.384241:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:12146:x1875469110679040:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788587008.384356:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:12146:x1875469110679040:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 Request processed in 117us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587008.384373:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 151 00000100:00100000:1.0:1788587008.386073:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587008.387258:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679168 00000100:00100000:3.0:1788587008.387271:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679168 00000100:00100000:3.0:1788587008.387332:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:3.0:1788587008.387343:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:2409:x1875469110679168:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587008.387358:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587008.387394:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda273 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a9 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587008.387450:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:3.0:1788587008.387455:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587008.387527:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+13:2409:x1875469110679168:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 186us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587008.387535:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:3.0:1788587008.387642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587008.388453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679296 00000100:00100000:1.0:1788587008.388461:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679296 00000100:00100000:1.0:1788587008.388544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 152 00000100:00100000:1.0:1788587008.388553:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:12146:x1875469110679296:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788587008.388750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:12146:x1875469110679296:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 Request processed in 198us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.388758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 152 00000100:00080000:3.0:1788587008.389161:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788587008.405153:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587008.469073:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587008.852606:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587008.852615:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587008.852645:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788587008.852652:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788587009.494640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587010.145927:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587010.146019:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679424 00000100:00100000:0.0:1788587010.146029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679424 00000100:00100000:0.0:1788587010.146100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 153 00000100:00100000:0.0:1788587010.146110:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+13:12189:x1875469110679424:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788587010.146131:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587010.146151:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109b0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146214:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146228:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146241:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146257:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146264:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146271:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146450:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146555:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146561:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146567:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587010.146571:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146644:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146658:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:0.0:1788587010.146661:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587010.146666:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146673:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146686:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146692:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146698:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146703:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587010.146713:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146718:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146726:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f5b8638ec00) 00010000:00010000:0.0:1788587010.146728:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587010.146731:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146736:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda28f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146766:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda281 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109b0 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146776:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:0.0:1788587010.146778:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587010.146783:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109b0 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.146793:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4a00, rc 0) 00000100:00080000:3.0:1788587010.146931:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587010.146971:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+13:12189:x1875469110679424:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 860us (1051us total) trans 0 rc 301/301 00000100:00100000:0.0:1788587010.146980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 153 00000100:00100000:1.0:1788587010.157679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587010.157878:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679680 00000100:00100000:3.0:1788587010.157888:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679680 00000100:00100000:3.0:1788587010.157940:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 154 00000100:00100000:3.0:1788587010.157950:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+13:12189:x1875469110679680:12345-192.168.203.1@tcp:36:lfs.0 00010000:00010000:3.0:1788587010.158005:0:10048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587010.158031:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fd9bd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107d4 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.158063:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788587010.158069:0:10048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587010.158138:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.158153:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.158161:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.158194:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.158210:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 5 pid: 6521 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587010.158224:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127518592:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587010.158328:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e85cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587010.160881:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127518592:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587010.160917:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587010.161193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587010.161254:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679808 00000100:00100000:3.0:1788587010.161261:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679808 00010000:00010000:3.0:1788587010.161324:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 6 pid: 6521 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587010.161390:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 80 00000100:00100000:3.0:1788587010.161401:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110679808:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587010.161439:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587010.161447:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 6 pid: 6521 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161464:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 6 pid: 6521 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161486:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda257 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109a2 expref: 6 pid: 6521 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161501:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788587010.161506:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161516:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161523:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161547:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788587010.161730:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587010.161788:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110679808:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 389us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587010.161797:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 80 00010000:00010000:3.0:1788587010.161822:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161836:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161857:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161867:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.161875:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.165937:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.165958:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.165969:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587010.165986:0:10048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000012980ea reply state 00000000c2a5e7e3 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.165997:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166004:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587010.166007:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587010.166013:0:10048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788587010.166019:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788587010.166042:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166049:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166055:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166061:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587010.166066:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166073:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166084:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788587010.166086:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587010.166089:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166095:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda296 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587010.166117:0:10048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000012980ea reply state 00000000c2a5e7e3 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166126:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.166131:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f5b85f9f200) 00010000:00010000:3.0:1788587010.166133:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587010.166142:0:10048:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788587010.166251:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+14:12189:x1875469110679680:12345-192.168.203.1@tcp:36:lfs.0 Request processed in 8299us (8580us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788587010.166261:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 154 00000100:00100000:0.0:1788587010.236852:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.237536:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110679936 00000100:00100000:1.0:1788587010.237546:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110679936 00000100:00100000:1.0:1788587010.237711:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 155 00000100:00100000:1.0:1788587010.237721:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+14:12197:x1875469110679936:12345-192.168.203.1@tcp:101:lctl.0 00010000:00010000:1.0:1788587010.237745:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587010.237766:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda2ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109b7 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.237828:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda2b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.237841:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.237852:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587010.237896:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788587010.237907:0:13553:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587010.237930:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.237953:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda2ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109b7 expref: 16 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.237970:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109b7 expref: 15 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.237979:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:1.0:1788587010.237982:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587010.237986:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466a00, rc 0) 00000100:00100000:1.0:1788587010.238045:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+15:12197:x1875469110679936:12345-192.168.203.1@tcp:101:lctl.0 Request processed in 326us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587010.238052:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 155 00000100:00100000:1.0:1788587010.291515:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587010.292449:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110680064 00000100:00100000:0.0:1788587010.292462:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110680064 00000100:00100000:0.0:1788587010.292530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 156 00000100:00100000:0.0:1788587010.292540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+15:12202:x1875469110680064:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:0.0:1788587010.292763:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587010.292784:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda2b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109be expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292849:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292865:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292878:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292890:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292899:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292906:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292983:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292992:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.292998:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587010.293044:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788587010.293048:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587010.293068:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293080:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293086:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293092:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293098:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587010.293102:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293110:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293121:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:0.0:1788587010.293124:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587010.293128:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293135:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda2c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293148:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293164:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293170:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293175:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587010.293178:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293185:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293194:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f5b85f9f200) 00010000:00010000:0.0:1788587010.293197:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587010.293200:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293207:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda2c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda2b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109be expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293247:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109be expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.293255:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:0.0:1788587010.293257:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587010.293265:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788587010.293331:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+16:12202:x1875469110680064:12345-192.168.203.1@tcp:101:bash.0 Request processed in 793us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587010.293340:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 156 00000100:00100000:0.0:1788587010.296209:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587010.296365:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110680320 00000100:00100000:3.0:1788587010.296376:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110680320 00000100:00100000:3.0:1788587010.296477:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 157 00000100:00100000:3.0:1788587010.296488:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbfb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+16:12202:x1875469110680320:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788587010.296508:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587010.296529:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda2d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109c5 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.296625:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.296640:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.296652:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.296669:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.296676:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.296683:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587010.296988:0:10048:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788587010.297144:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297153:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297160:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297193:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297201:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297207:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297214:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587010.297217:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297225:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297236:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587010.297239:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587010.297244:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297250:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda2dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587010.297552:0:10048:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ace76b04 reply state 000000003470a362 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297564:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297570:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788587010.297572:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587010.297575:0:10048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788587010.297606:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda2d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 19 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297620:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 18 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.297627:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587010.297629:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587010.297632:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecde00, rc 0) 00000100:00100000:3.0:1788587010.297688:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbfb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+19:12202:x1875469110680320:12345-192.168.203.1@tcp:101:bash.0 Request processed in 1202us (1488us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788587010.297695:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 157 00000100:00100000:1.0:1788587010.301644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.301719:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110680448 00000100:00100000:2.0:1788587010.301729:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110680448 00000100:00100000:2.0:1788587010.301806:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00080000:0.0:1788587010.301897:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587010.301939:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba052b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110680448:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587010.301958:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587010.301978:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109cc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587010.302082:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587010.302104:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1788587010.302108:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587010.302118:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.302138:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.302151:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71800, rc 0) 00000100:00100000:2.0:1788587010.302343:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba052b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110680448:12345-192.168.203.1@tcp:101:bash.0 Request processed in 407us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.302359:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:1.0:1788587010.311143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.312158:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110680576 00000100:00100000:2.0:1788587010.312185:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110680576 00000100:00100000:2.0:1788587010.312674:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:2.0:1788587010.312689:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:12202:x1875469110680576:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587010.312710:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587010.312729:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109d3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.312762:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.312772:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587010.313691:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587010.313705:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.313750:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.313767:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.314118:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1875469127518720:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587010.314259:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587010.317327:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1875469127518720:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587010.317382:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.317458:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71200, rc 0) 00000100:00100000:2.0:1788587010.317527:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:12202:x1875469110680576:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4842us (6392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.317536:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:1.0:1788587010.321889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587010.324982:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110680704 00000100:00100000:3.0:1788587010.325066:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110680704 00010000:00010000:2.0:1788587010.329063:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.329159:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:2.0:1788587010.329172:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110680704:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587010.329189:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587010.329209:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.329223:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.329248:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda2f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109cc expref: 7 pid: 8436 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.329274:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587010.329279:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587010.329288:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.329322:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.329369:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.329383:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8450:1875469127518848:192.168.203.1@tcp:105: 00000100:00100000:2.0:1788587010.329513:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587010.331465:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8450:1875469127518848:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788587010.331489:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587010.331578:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2408:x1875469110680704:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 2408us (9697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.331589:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:3.0:1788587010.332452:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.332568:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110680960 00000100:00100000:2.0:1788587010.332576:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110680960 00000100:00100000:2.0:1788587010.332634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:2.0:1788587010.332643:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:12202:x1875469110680960:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:2.0:1788587010.332928:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+20:12202:x1875469110680960:12345-192.168.203.1@tcp:35:bash.0 Request processed in 285us (478us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788587010.332935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:0.0:1788587010.388766:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587010.388791:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127518976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587010.388856:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587010.388999:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127518976 00000100:00100000:2.0:1788587010.389008:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127518976 00000100:00100000:2.0:1788587010.389072:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788587010.389083:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127518976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587010.389134:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788587010.389191:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127518976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.389198:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788587010.389291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127518976:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788587010.389295:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587010.389576:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127519104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587010.389607:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587010.389669:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127519104 00000100:00100000:3.0:1788587010.389674:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127519104 00000100:00100000:3.0:1788587010.389731:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788587010.389738:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127519104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587010.389759:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788587010.389795:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127519104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587010.389801:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788587010.389813:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a82296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127519104:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788587010.389912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587010.413363:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.413459:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110681216 00000100:00100000:2.0:1788587010.413469:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110681216 00000100:00100000:2.0:1788587010.413534:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 158 00000100:00100000:2.0:1788587010.413545:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+20:12213:x1875469110681216:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587010.413569:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587010.413589:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109da expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587010.413686:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788587010.413920:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda306 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109da expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.413936:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:2.0:1788587010.413939:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587010.413945:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109da expref: 22 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.413959:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71800, rc 0) 00000100:00100000:2.0:1788587010.414021:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+21:12213:x1875469110681216:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 478us (676us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788587010.414043:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 158 00000100:00100000:3.0:1788587010.423190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.423255:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110681472 00000100:00100000:2.0:1788587010.423266:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110681472 00000100:00100000:2.0:1788587010.423378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 37 00000100:00100000:2.0:1788587010.423388:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+21:12213:x1875469110681472:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788587010.423651:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+22:12213:x1875469110681472:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 264us (469us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788587010.423659:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 37 00000100:00100000:3.0:1788587010.499891:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587010.499983:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110681600 00000100:00100000:0.0:1788587010.500004:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110681600 00000100:00100000:0.0:1788587010.500065:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 159 00000100:00100000:0.0:1788587010.500075:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:12219:x1875469110681600:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788587010.500099:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587010.500119:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.500192:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda31b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.500206:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.500217:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587010.500258:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788587010.500262:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587010.500309:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.500335:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109e1 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.500363:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda31b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109e1 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.500372:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:0.0:1788587010.500375:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587010.500379:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788587010.500599:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+23:12219:x1875469110681600:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 524us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587010.500608:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 159 00000100:00100000:0.0:1788587010.505321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587010.505511:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110681856 00000100:00100000:3.0:1788587010.505521:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110681856 00000100:00100000:3.0:1788587010.505581:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 160 00000100:00100000:3.0:1788587010.505591:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+23:12219:x1875469110681856:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587010.505617:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587010.505637:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda322 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109e8 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.505742:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda329 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.505756:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda329 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.505769:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda329 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587010.505903:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587010.506037:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda322 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109e8 expref: 26 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.506079:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda329 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109e8 expref: 25 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587010.506088:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587010.506092:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587010.506095:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd000, rc 0) 00000100:00100000:3.0:1788587010.506197:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+25:12219:x1875469110681856:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 608us (885us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788587010.506205:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 160 00000100:00100000:3.0:1788587010.510193:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587010.510247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.510406:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110681984 00000100:00100000:2.0:1788587010.510445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110681984 00000100:00100000:2.0:1788587010.510511:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00100000:2.0:1788587010.510522:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+25:2406:x1875469110681984:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587010.510537:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587010.510560:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda329 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109e8 expref: 25 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.510579:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587010.510585:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587010.510698:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110682240 00000100:00100000:1.0:1788587010.510704:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110682240 00000100:00100000:1.0:1788587010.510753:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 161 00000100:00100000:1.0:1788587010.510762:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+25:12219:x1875469110682240:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587010.510882:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587010.510900:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda337 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109ef expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.511026:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda33e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.511041:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda33e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.511052:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda33e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587010.511064:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788587010.511163:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda337 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109ef expref: 28 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.511178:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda33e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109ef expref: 27 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.511186:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:1.0:1788587010.511189:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788587010.511191:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466c00, rc 0) 00000100:00100000:1.0:1788587010.511237:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+27:12219:x1875469110682240:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 476us (989us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788587010.511245:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 161 00000100:00100000:2.0:1788587010.512021:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+26:2406:x1875469110681984:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 1497us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.512031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 12 00010000:00010000:3.0:1788587010.516560:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587010.517898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.518035:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110682368 00000100:00100000:1.0:1788587010.518046:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110682368 00000100:00100000:1.0:1788587010.518104:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:1.0:1788587010.518113:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110682368:12345-192.168.203.1@tcp:1:lfs.0 00010000:00010000:1.0:1788587010.518158:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.518190:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.518198:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587010.518202:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587010.518206:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.518241:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.518255:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 6 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587010.518279:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1875469127519232:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788587010.518385:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b986fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587010.521397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.521604:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1875469127519232:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587010.521634:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587010.521773:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110682496 00000100:00100000:0.0:1788587010.521838:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110682496 00002000:00100000:0.0:1788587010.521886:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f5a83773800 x1875469110682496/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:326/0 lens 504/0 e 0 to 0 dl 1788587021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587010.521896:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83773800 with x1875469110682496 ext(0->12) 00010000:00010000:0.0:1788587010.521904:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 7 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.521919:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 7 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587010.521926:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5a83773800 00000100:00100000:0.0:1788587010.521969:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:0.0:1788587010.521979:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110682496:12345-192.168.203.1@tcp:4:lfs.0 00000100:00100000:0.0:1788587010.522873:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:2408:x1875469110682496:12345-192.168.203.1@tcp:4:lfs.0 Request processed in 892us (1482us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788587010.522883:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 2 00002000:00100000:0.0:1788587010.522892:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f5a83773800 x1875469110682496/t4294967306(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:326/0 lens 504/448 e 0 to 0 dl 1788587021 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587010.522901:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83773800 with x1875469110682496 ext(0->12) 00010000:00010000:0.0:1788587010.522908:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 9 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.522922:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 9 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587010.522929:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5a83773800 00000100:00100000:0.0:1788587010.525695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.525830:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110682624 00000100:00100000:2.0:1788587010.525839:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110682624 00010000:00010000:2.0:1788587010.525881:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 9 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.525928:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 82 00000100:00100000:2.0:1788587010.525937:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110682624:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587010.525952:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788587010.525981:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788587010.525984:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587010 00002000:00010000:2.0:1788587010.525987:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788587010 00002000:00010000:2.0:1788587010.525989:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788587010 00002000:00010000:2.0:1788587010.525991:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788587010.525997:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 9 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.526011:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 9 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.526035:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067222554/0xfbc93bbea5fda2ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109d3 expref: 9 pid: 8434 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.526053:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587010.526057:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587010.526063:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.526087:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.526162:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587010.526163:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.526171:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.526192:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.526211:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.526219:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110682624:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 283us (533us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587010.526219:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.526226:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 82 00010000:00010000:1.0:1788587010.526227:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587010.526231:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.526240:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.526252:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.526261:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda34c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587010.526312:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110682368:12345-192.168.203.1@tcp:1:lfs.0 Request processed in 8200us (8420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587010.526320:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:2.0:1788587010.528398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.528723:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110682880 00000100:00100000:1.0:1788587010.528732:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110682880 00000100:00100000:1.0:1788587010.528909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:1.0:1788587010.528930:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+26:12219:x1875469110682880:12345-192.168.203.1@tcp:35:lfs.0 00000004:00010000:1.0:1788587010.528988:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda33e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109ef expref: 26 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587010.529152:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788587010.529178:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788587010.529521:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788587010.529554:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.529568:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 30 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.529578:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.529610:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 30 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.529626:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 30 pid: 10048 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587010.529644:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875469127519360:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788587010.529728:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587010.535704:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587010.535792:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110683008 00000100:00100000:0.0:1788587010.535801:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110683008 00010000:00010000:0.0:1788587010.535837:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 31 pid: 10048 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587010.535878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 83 00000100:00100000:0.0:1788587010.535887:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+31:2408:x1875469110683008:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587010.535903:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587010.535909:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 31 pid: 10048 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.535936:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 31 pid: 10048 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.535957:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:0.0:1788587010.535963:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.535971:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.535978:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.536006:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587010.536055:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+31:2408:x1875469110683008:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 169us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587010.536063:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 83 00010000:00010000:1.0:1788587010.536587:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda2ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109c5 expref: 30 pid: 10048 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587010.536606:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875469127519360:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788587010.536633:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.536643:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.536649:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587010.536740:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788587010.536835:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788587010.536909:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127519488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587010.536953:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587010.536983:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82b9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587010.537110:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127519488 00000100:00100000:0.0:1788587010.537115:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127519488 00000100:00100000:0.0:1788587010.537173:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788587010.537180:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127519488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788587010.537255:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127519488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00080000:3.0:1788587010.537390:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587010.537465:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587010.537806:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83773100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127519488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788587010.537928:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788587010.537977:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127519616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587010.538023:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587010.538045:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587010.538252:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127519616 00000100:00100000:3.0:1788587010.538257:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127519616 00000100:00100000:3.0:1788587010.538304:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587010.538313:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127519616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587010.538468:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875469127519616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 156us (444us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788587010.538476:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788587010.538688:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127519616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788587010.538727:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788587010.538757:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.538766:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.538774:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.538780:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587010.538785:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.538804:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.538821:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587010.538823:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788587010.538828:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.538835:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda353 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587010.538927:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788587010.538980:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788587010.539165:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356469573248ns, next at 357469571633ns, rc = 0 00000001:00080000:2.0:1788587010.539175:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788587010.539198:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587010.539201:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587010.539208:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda33e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109ef expref: 34 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.539409:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+33:12219:x1875469110682880:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 10480us (11017us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788587010.539446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 38 00000020:00080000:2.0:1788587010.539452:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788587010.541831:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.541915:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110683136 00000100:00100000:2.0:1788587010.541924:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110683136 00000100:00100000:2.0:1788587010.542012:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 162 00000100:00100000:2.0:1788587010.542021:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+33:12219:x1875469110683136:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587010.542058:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587010.542081:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda35a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.542146:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda35a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109f6 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.542161:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda35a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109f6 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.542178:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587010.542181:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587010.542185:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70c00, rc 0) 00000100:00100000:2.0:1788587010.542275:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+34:12219:x1875469110683136:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 254us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.542281:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 162 00000100:00100000:1.0:1788587010.545078:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.545206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110683392 00000100:00100000:2.0:1788587010.545216:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110683392 00000100:00100000:2.0:1788587010.545277:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:2.0:1788587010.545287:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+34:12219:x1875469110683392:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788587010.545556:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+35:12219:x1875469110683392:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 270us (484us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788587010.545564:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:3.0:1788587010.607125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587010.607602:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110683648 00000100:00100000:0.0:1788587010.607611:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110683648 00000100:00100000:1.0:1788587010.607752:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 163 00000100:00100000:1.0:1788587010.607760:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+35:12229:x1875469110683648:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587010.607778:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587010.607794:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda361 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c8109fd expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587010.607872:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788587010.607947:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda361 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109fd expref: 37 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.607958:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:1.0:1788587010.607960:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587010.607964:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109fd expref: 37 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.607987:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467a00, rc 0) 00000100:00100000:1.0:1788587010.608059:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+36:12229:x1875469110683648:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 299us (946us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788587010.608067:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 163 00000100:00100000:3.0:1788587010.609834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.609984:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110683776 00000100:00100000:1.0:1788587010.610002:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110683776 00000100:00100000:1.0:1788587010.610058:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 164 00000100:00100000:1.0:1788587010.610068:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+36:12229:x1875469110683776:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:1.0:1788587010.610135:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610151:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610162:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610173:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610181:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610187:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610263:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610288:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610296:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587010.610340:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610366:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610373:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610380:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610385:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587010.610390:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610397:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610408:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587010.610411:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587010.610439:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610446:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda36f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610474:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610480:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610485:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610490:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587010.610493:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610500:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610508:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:1.0:1788587010.610511:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587010.610518:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610523:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda376 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610532:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610538:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610543:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610554:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587010.610557:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610563:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610571:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587010.610573:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587010.610576:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587010.610581:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda37d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587010.610653:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+36:12229:x1875469110683776:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 584us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587010.610661:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 164 00000100:00100000:0.0:1788587010.613583:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.613672:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684032 00000100:00100000:2.0:1788587010.613681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684032 00000100:00100000:2.0:1788587010.613735:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:2.0:1788587010.613749:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+36:12229:x1875469110684032:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788587010.614651:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+37:12229:x1875469110684032:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 903us (1073us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788587010.614660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:3.0:1788587010.659192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.661184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684288 00000100:00100000:2.0:1788587010.661199:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684288 00000100:00100000:2.0:1788587010.661755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 165 00000100:00100000:2.0:1788587010.661769:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+37:12232:x1875469110684288:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587010.661797:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587010.661818:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda384 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a04 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.661892:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.661908:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.661920:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.661931:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.661938:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.661945:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662074:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662096:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662104:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587010.662115:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788587010.662189:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662196:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662203:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662208:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587010.662213:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662221:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662232:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587010.662235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587010.662240:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662246:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda38b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662271:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662298:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662304:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662309:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587010.662313:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662319:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662328:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:2.0:1788587010.662331:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587010.662334:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662341:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda392 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662399:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda384 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662519:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587010.662529:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587010.662532:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587010.662540:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70200, rc 0) 00000100:00100000:2.0:1788587010.662603:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+39:12232:x1875469110684288:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 837us (3420us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788587010.662612:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 165 00000100:00100000:1.0:1788587010.667101:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.667140:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.667171:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.667236:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587010.667242:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684672 00000100:00100000:0.0:1788587010.667266:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684672 00000100:00100000:2.0:1788587010.667288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684416 00000100:00100000:2.0:1788587010.667292:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684416 00000100:00100000:2.0:1788587010.667326:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 380 00000100:00100000:0.0:1788587010.667326:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 122 00000100:00100000:2.0:1788587010.667334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110684416:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587010.667334:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110684672:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587010.667412:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110684672:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587010.667442:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 122 00000100:00080000:0.0:1788587010.667464:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587010.668610:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110684416:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 1269us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587010.668621:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 380 00000100:00100000:3.0:1788587010.670820:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684928 00000100:00100000:3.0:1788587010.670834:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684928 00000100:00100000:3.0:1788587010.670918:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684544 00000100:00100000:3.0:1788587010.670922:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684544 00000100:00100000:3.0:1788587010.670948:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 277 00000100:00100000:3.0:1788587010.670957:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110684928:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587010.671031:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110684928:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 74us (3858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587010.671038:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 277 00000100:00100000:3.0:1788587010.671054:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 278 00000100:00100000:3.0:1788587010.671061:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110684544:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587010.671085:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110684544:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (3850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587010.671091:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 278 00000100:00080000:3.0:1788587010.671116:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587010.675520:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.675651:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587010.683039:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110684800 00000100:00100000:2.0:1788587010.683054:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110684800 00000100:00100000:2.0:1788587010.683125:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110685056 00000100:00100000:2.0:1788587010.683129:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110685056 00000100:00100000:2.0:1788587010.683166:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 279 00000100:00100000:2.0:1788587010.683177:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110684800:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587010.683199:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 166 00000100:00100000:0.0:1788587010.683208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+39:12232:x1875469110685056:12345-192.168.203.1@tcp:54:lfs.0 00000100:00100000:2.0:1788587010.683258:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110684800:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 84us (7747us total) trans 0 rc 0/0 00010000:00010000:0.0:1788587010.683264:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683281:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683293:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683327:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683334:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683340:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683355:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587010.683359:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587010.683510:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 279 00010000:00010000:0.0:1788587010.683523:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683536:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:0.0:1788587010.683539:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587010.683543:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587010.683550:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda3a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587010.683589:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+39:12232:x1875469110685056:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 382us (7938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587010.683595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 166 00000100:00100000:0.0:1788587010.685273:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587010.685341:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110685312 00000100:00100000:1.0:1788587010.685365:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110685312 00000100:00100000:1.0:1788587010.685441:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:1.0:1788587010.685451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+39:12232:x1875469110685312:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788587010.685693:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+40:12232:x1875469110685312:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 242us (436us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788587010.685701:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:3.0:1788587011.060886:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.061074:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110685568 00000100:00100000:2.0:1788587011.061084:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110685568 00000100:00100000:2.0:1788587011.061206:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 167 00000100:00100000:2.0:1788587011.061214:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+40:12263:x1875469110685568:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:2.0:1788587011.061236:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587011.061267:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a0b expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.061463:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.061476:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.061485:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587011.061493:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788587011.061577:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a0b expref: 43 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.061590:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a0b expref: 42 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.061606:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587011.061608:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587011.061611:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70a00, rc 0) 00000100:00100000:2.0:1788587011.061668:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+42:12263:x1875469110685568:12345-192.168.203.1@tcp:101:cat.0 Request processed in 456us (789us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788587011.061674:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 167 00000100:00100000:3.0:1788587011.068322:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587011.068392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110685824 00000100:00100000:1.0:1788587011.068404:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110685824 00000100:00100000:3.0:1788587011.068448:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.068504:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110685952 00000100:00100000:2.0:1788587011.068509:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110685952 00000100:00100000:2.0:1788587011.068619:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:2.0:1788587011.068634:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+43:2409:x1875469110685952:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587011.068649:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587011.068687:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a0b expref: 43 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.068704:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587011.068709:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587011.068774:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+42:2409:x1875469110685952:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.068782:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:1.0:1788587011.068888:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:1.0:1788587011.068895:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+41:12263:x1875469110685824:12345-192.168.203.1@tcp:35:cat.0 00000100:00100000:1.0:1788587011.069101:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+42:12263:x1875469110685824:12345-192.168.203.1@tcp:35:cat.0 Request processed in 206us (787us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788587011.069108:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:3.0:1788587011.137229:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.137572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110686208 00000100:00100000:2.0:1788587011.137582:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110686208 00000100:00100000:2.0:1788587011.137641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 168 00000100:00100000:2.0:1788587011.137651:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+42:12269:x1875469110686208:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:2.0:1788587011.137674:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587011.137677:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587011.137704:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda31b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109e1 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.137722:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587011.137728:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587011.137741:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a12 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.137850:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.137863:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.137888:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.137923:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.137935:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 42 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587011.137948:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127519744:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587011.138052:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b851699c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587011.144633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587011.144703:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110686336 00000100:00100000:0.0:1788587011.144713:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110686336 00000100:00100000:2.0:1788587011.144804:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127519744:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587011.144818:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 43 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.144830:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587011.145171:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 84 00000100:00100000:0.0:1788587011.145183:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+43:2409:x1875469110686336:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587011.145198:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587011.145206:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 43 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.145384:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 43 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.145468:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a04 expref: 43 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.145484:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:0.0:1788587011.145489:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.145499:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.145508:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.145540:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587011.145627:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.145636:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587011.145720:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:0.0:1788587011.145821:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+43:2409:x1875469110686336:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 639us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587011.145829:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 84 00010000:00010000:2.0:1788587011.145853:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.145870:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.145889:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587011.145892:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587011.145895:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70000, rc 0) 00000100:00100000:2.0:1788587011.145925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+42:12269:x1875469110686208:12345-192.168.203.1@tcp:101:dd.0 Request processed in 8274us (8704us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788587011.145932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 168 00000100:00100000:0.0:1788587011.149990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.150279:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110686464 00000100:00100000:3.0:1788587011.150288:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110686464 00000100:00100000:3.0:1788587011.150366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 169 00000100:00100000:3.0:1788587011.150377:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+42:12269:x1875469110686464:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:3.0:1788587011.150399:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587011.150459:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda3d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a19 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.150517:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.150544:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.150556:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.150670:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda3d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.150690:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.150700:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.150703:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587011.150707:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd600, rc 0) 00000100:00100000:3.0:1788587011.150766:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+43:12269:x1875469110686464:12345-192.168.203.1@tcp:101:dd.0 Request processed in 392us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587011.150775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 169 00000100:00100000:1.0:1788587011.156900:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.157826:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110686720 00000100:00100000:2.0:1788587011.157839:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110686720 00000100:00100000:2.0:1788587011.158078:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 170 00000100:00100000:2.0:1788587011.158200:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+43:12269:x1875469110686720:12345-192.168.203.1@tcp:36:dd.0 00010000:00010000:2.0:1788587011.158831:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.158850:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.158861:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587011.159070:0:13553:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788587011.159442:0:13553:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210a6e89 reply state 000000006aa58bca transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.159459:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.159467:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587011.159470:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587011.159488:0:13553:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587011.159869:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+46:12269:x1875469110686720:12345-192.168.203.1@tcp:36:dd.0 Request processed in 1778us (2975us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788587011.159879:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 170 00000020:00080000:2.0:1788587011.159885:0:13553:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587011.369529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.369637:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110686848 00000100:00100000:2.0:1788587011.369646:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110686848 00000100:00100000:2.0:1788587011.369699:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 171 00000100:00100000:2.0:1788587011.369709:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+46:12283:x1875469110686848:12345-192.168.203.1@tcp:101:stat.0 00010000:00010000:2.0:1788587011.369731:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587011.369751:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda3ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a20 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369821:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369836:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369848:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369859:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369866:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369873:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369967:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.369977:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.370010:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.370023:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 47 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587011.370036:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127519872:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587011.370128:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b851699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587011.374871:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127519872:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587011.374902:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587011.375790:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.375895:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110687104 00000100:00100000:3.0:1788587011.375904:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110687104 00000100:00100000:3.0:1788587011.375959:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:3.0:1788587011.375970:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+48:6174:x1875469110687104:12345-192.168.203.1@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788587011.376357:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+49:6174:x1875469110687104:12345-192.168.203.1@tcp:35:ldlm_bl.0 Request processed in 388us (569us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788587011.376382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:0.0:1788587011.378843:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.378958:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110687232 00000100:00100000:2.0:1788587011.378967:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110687232 00010000:00010000:2.0:1788587011.379014:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 49 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587011.379084:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 85 00000100:00100000:2.0:1788587011.379094:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+49:2408:x1875469110687232:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587011.379109:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587011.379125:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 49 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.379138:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 49 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.379160:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda3ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a12 expref: 49 pid: 6521 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.379176:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587011.379180:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.379189:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.379196:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.379227:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587011.379404:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+48:2408:x1875469110687232:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 310us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.379412:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 85 00010000:00010000:1.0:1788587011.379571:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379581:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587011.379631:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788587011.379636:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587011.379660:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379674:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379684:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379690:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379705:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379711:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587011.379716:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379725:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379735:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587011.379739:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587011.379743:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379749:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda3f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379759:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379765:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379772:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379778:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587011.379781:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379797:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379806:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:1.0:1788587011.379809:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587011.379812:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379817:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda3fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379847:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda3ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a20 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379860:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a20 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.379868:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587011.379870:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587011.379872:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70e00, rc 0) 00000100:00100000:1.0:1788587011.379901:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+47:12283:x1875469110686848:12345-192.168.203.1@tcp:101:stat.0 Request processed in 10194us (10383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587011.379909:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 171 00000100:00100000:0.0:1788587011.412984:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587011.413011:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127520000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587011.413097:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587011.413176:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127520000 00000100:00100000:0.0:1788587011.413184:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127520000 00000100:00100000:0.0:1788587011.413231:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788587011.413400:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587011.413411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127520128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587011.413469:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587011.413508:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127520128 00000100:00100000:1.0:1788587011.413512:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127520128 00000100:00100000:1.0:1788587011.413555:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587011.413562:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127520128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587011.413584:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788587011.413628:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127520128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587011.413662:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587011.413748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127520128:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788587011.414610:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587011.414915:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127520000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587011.414946:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788587011.415011:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127520000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587011.415019:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788587011.415196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127520256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587011.415244:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587011.415716:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127520000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587011.416206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127520256 00000100:00100000:0.0:1788587011.416214:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127520256 00000100:00100000:0.0:1788587011.417142:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587011.417157:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127520256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587011.417192:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788587011.417409:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127520256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 256us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587011.417733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788587011.417868:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127520256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587011.442007:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.445823:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110687488 00000100:00100000:3.0:1788587011.445837:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110687488 00000100:00100000:3.0:1788587011.445970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 172 00000100:00100000:3.0:1788587011.445981:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+47:12289:x1875469110687488:12345-192.168.203.1@tcp:36:truncate.0 00010000:00010000:3.0:1788587011.446042:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587011.446070:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda402 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a20 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.446092:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.446097:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587011.446511:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.446527:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.446536:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587011.446577:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788587011.446601:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5320d99 reply state 000000005b04ef47 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.446612:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.446634:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.446637:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587011.446640:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587011.446757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+49:12289:x1875469110687488:12345-192.168.203.1@tcp:36:truncate.0 Request processed in 777us (4759us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788587011.446765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 172 00000020:00080000:3.0:1788587011.446771:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587011.544655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587011.613816:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.613890:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110687616 00000100:00100000:2.0:1788587011.613900:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110687616 00000100:00100000:2.0:1788587011.613963:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 173 00000100:00100000:2.0:1788587011.613974:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+49:12303:x1875469110687616:12345-192.168.203.1@tcp:101:stat.0 00010000:00010000:2.0:1788587011.613997:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587011.614016:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda410 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a27 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614104:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614118:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614129:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614139:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614146:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614153:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614221:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614230:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614238:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587011.614279:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788587011.614284:0:13553:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587011.614305:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614346:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614355:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614361:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614368:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614374:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587011.614379:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614386:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614398:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587011.614401:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587011.614406:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614413:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda417 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614453:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614459:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614471:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614476:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587011.614479:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614486:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614494:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:2.0:1788587011.614496:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587011.614500:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614505:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda41e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614531:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda410 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 51 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614544:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 50 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587011.614550:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587011.614552:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587011.614554:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71600, rc 0) 00000100:00100000:2.0:1788587011.614617:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+50:12303:x1875469110687616:12345-192.168.203.1@tcp:101:stat.0 Request processed in 646us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587011.614633:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 173 00000100:00100000:2.0:1788587011.712949:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587011.713054:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110687872 00000100:00100000:1.0:1788587011.713065:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110687872 00000100:00100000:1.0:1788587011.713205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 174 00000100:00100000:1.0:1788587011.713217:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+50:12313:x1875469110687872:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587011.713238:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587011.713260:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda42c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a2e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587011.713574:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788587011.713735:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda42c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a2e expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.713751:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:1.0:1788587011.713755:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587011.713761:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda42c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a2e expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.713793:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466600, rc 0) 00000100:00100000:1.0:1788587011.713858:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+51:12313:x1875469110687872:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 643us (918us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788587011.713866:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 174 00000100:00100000:1.0:1788587011.718007:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587011.718099:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110688128 00000100:00100000:2.0:1788587011.718109:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110688128 00000100:00100000:2.0:1788587011.718167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:2.0:1788587011.718178:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+51:12313:x1875469110688128:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788587011.718466:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+52:12313:x1875469110688128:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 288us (466us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788587011.718474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:0.0:1788587011.761662:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.761785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110688384 00000100:00100000:3.0:1788587011.761795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110688384 00000100:00100000:3.0:1788587011.761851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 175 00000100:00100000:3.0:1788587011.761860:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+52:12319:x1875469110688384:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788587011.761881:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587011.761901:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda43a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a35 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.761995:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.762010:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 53 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.762021:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.762050:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 53 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.762080:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 53 pid: 13553 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587011.762106:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127520384:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587011.762194:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e85600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587011.764319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587011.764411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110688512 00000100:00100000:1.0:1788587011.764438:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110688512 00010000:00010000:1.0:1788587011.764474:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 54 pid: 13553 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587011.764511:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 86 00000100:00100000:1.0:1788587011.764520:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:2409:x1875469110688512:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587011.764534:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587011.764541:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 54 pid: 13553 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.764554:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 54 pid: 13553 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.764577:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587011.764582:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.764592:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.764616:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.764636:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587011.764700:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:2409:x1875469110688512:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 180us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587011.764708:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 86 00010000:00010000:3.0:1788587011.765292:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda425 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a27 expref: 53 pid: 13553 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587011.765311:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127520384:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587011.765333:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.765354:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.765361:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587011.765388:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788587011.765560:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda43a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.765576:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.765584:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.765596:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587011.765599:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b91ecd000, rc 0) 00000100:00100000:3.0:1788587011.765889:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+53:12319:x1875469110688384:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4029us (4244us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788587011.765898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 175 00000100:00100000:0.0:1788587011.769955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.770094:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110688768 00000100:00100000:3.0:1788587011.770104:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110688768 00000100:00100000:3.0:1788587011.770165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 176 00000100:00100000:3.0:1788587011.770176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+53:12319:x1875469110688768:12345-192.168.203.1@tcp:36:bash.0 00010000:00010000:3.0:1788587011.770475:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.770493:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.770505:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587011.770543:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788587011.770565:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe5087f3 reply state 0000000027442c3a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.770578:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.770585:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.770587:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587011.770591:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587011.770680:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+56:12319:x1875469110688768:12345-192.168.203.1@tcp:36:bash.0 Request processed in 505us (733us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788587011.770702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 176 00000020:00080000:3.0:1788587011.770707:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788587011.783926:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.784017:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110688896 00000100:00100000:3.0:1788587011.784026:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110688896 00000100:00100000:3.0:1788587011.784134:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 177 00000100:00100000:3.0:1788587011.784145:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+56:12319:x1875469110688896:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788587011.784170:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587011.784195:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda456 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a3c expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.784306:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.784322:0:10048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.784331:0:10048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.784381:0:10048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.784396:0:10048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 57 pid: 6520 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587011.784411:0:10048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f19180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127520512:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587011.784852:0:10048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e85600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587011.789408:0:10048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f19180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10048:1875469127520512:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587011.789477:0:10048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587011.790398:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587011.790644:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110689024 00000100:00100000:0.0:1788587011.790663:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110689024 00010000:00010000:0.0:1788587011.790701:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 58 pid: 6520 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587011.790746:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 87 00000100:00100000:0.0:1788587011.790756:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+58:2408:x1875469110689024:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587011.790770:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587011.790777:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 58 pid: 6520 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.790791:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 58 pid: 6520 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.790833:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda441 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a35 expref: 58 pid: 6520 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.790849:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:0.0:1788587011.790854:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.790865:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.790872:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587011.790903:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587011.790970:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+57:2408:x1875469110689024:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 216us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587011.790978:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 87 00010000:00010000:3.0:1788587011.791165:0:10048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.791174:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587011.791267:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788587011.791271:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587011.791295:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.791329:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda456 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a3c expref: 57 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.791356:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a3c expref: 56 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.791364:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.791367:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587011.791370:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318aa00, rc 0) 00000100:00100000:3.0:1788587011.791409:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+56:12319:x1875469110688896:12345-192.168.203.1@tcp:101:bash.0 Request processed in 7266us (7492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587011.791463:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 177 00000100:00100000:2.0:1788587011.795661:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587011.796463:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110689280 00000100:00100000:1.0:1788587011.796475:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110689280 00000100:00100000:1.0:1788587011.796531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:1.0:1788587011.796542:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+56:12319:x1875469110689280:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:1.0:1788587011.796753:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+57:12319:x1875469110689280:12345-192.168.203.1@tcp:35:bash.0 Request processed in 212us (1100us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788587011.796761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:2.0:1788587011.863133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.863305:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110689536 00000100:00100000:3.0:1788587011.863316:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110689536 00000100:00100000:3.0:1788587011.863390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 178 00000100:00100000:3.0:1788587011.863454:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+57:12329:x1875469110689536:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587011.863480:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587011.863658:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a43 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587011.863758:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788587011.863854:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda464 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a43 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.863868:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:3.0:1788587011.863871:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587011.863876:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a43 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.863890:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8318b000, rc 0) 00000100:00100000:3.0:1788587011.864040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+58:12329:x1875469110689536:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 589us (915us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788587011.864048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 178 00000100:00100000:0.0:1788587011.871112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587011.871386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110689664 00000100:00100000:1.0:1788587011.871397:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110689664 00000100:00100000:1.0:1788587011.871476:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 179 00000100:00100000:1.0:1788587011.871488:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:12329:x1875469110689664:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:1.0:1788587011.871571:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871649:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871663:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871775:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871794:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871802:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871873:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871882:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871888:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587011.871935:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871948:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871954:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871961:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871968:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587011.871972:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.871980:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872751:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587011.872755:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587011.872760:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872768:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda472 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872782:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872788:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872794:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872799:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587011.872802:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872809:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872817:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:1.0:1788587011.872819:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587011.872822:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872828:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872850:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872856:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872862:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872867:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587011.872870:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872877:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872885:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587011.872887:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587011.872890:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.872896:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587011.874195:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:12329:x1875469110689664:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 1496us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587011.874209:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 179 00000100:00100000:2.0:1788587011.877845:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.877927:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110689920 00000100:00100000:3.0:1788587011.877937:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110689920 00000100:00100000:3.0:1788587011.877995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:3.0:1788587011.878006:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:12329:x1875469110689920:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:3.0:1788587011.878238:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+59:12329:x1875469110689920:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 233us (401us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788587011.878246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:0.0:1788587011.924794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.924965:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110690176 00000100:00100000:3.0:1788587011.925006:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110690176 00000100:00100000:3.0:1788587011.925066:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 180 00000100:00100000:3.0:1788587011.925076:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+59:12332:x1875469110690176:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587011.925099:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587011.925120:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda487 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a4a expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925201:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925216:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925227:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925238:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925245:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925250:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925396:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ac00/0xfbc93bbea5fda49c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925406:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ac00/0xfbc93bbea5fda49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925453:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ac00/0xfbc93bbea5fda49c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587011.925472:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788587011.925885:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925894:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925901:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925907:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecd000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587011.925912:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925920:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925932:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587011.925935:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587011.925940:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925947:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd000/0xfbc93bbea5fda48e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925960:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925966:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925984:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925990:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecde00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587011.925993:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.925999:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.926009:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788587011.926011:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587011.926014:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.926020:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecde00/0xfbc93bbea5fda495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.926061:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318b000/0xfbc93bbea5fda487 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a4a expref: 62 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.926076:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ac00/0xfbc93bbea5fda49c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a4a expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.926084:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.926085:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587011.926088:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1ac00, rc 0) 00000100:00100000:3.0:1788587011.926159:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+61:12332:x1875469110690176:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1083us (1373us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788587011.926176:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 180 00000100:00100000:0.0:1788587011.931284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.931360:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110690304 00000100:00100000:3.0:1788587011.931384:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110690304 00000100:00100000:3.0:1788587011.931482:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 181 00000100:00100000:3.0:1788587011.931491:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+61:12332:x1875469110690304:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:3.0:1788587011.931714:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931732:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931744:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931782:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931789:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931795:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931801:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587011.931805:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931813:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931824:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587011.931840:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587011.931846:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587011.931853:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587011.931923:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+61:12332:x1875469110690304:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 433us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587011.931931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 181 00000100:00100000:2.0:1788587011.934936:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587011.935287:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110690560 00000100:00100000:3.0:1788587011.935297:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110690560 00000100:00100000:3.0:1788587011.935362:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:3.0:1788587011.935372:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:12332:x1875469110690560:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788587011.935990:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+62:12332:x1875469110690560:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 617us (1062us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788587011.935999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:0.0:1788587011.939084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587011.939235:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110690688 00000100:00100000:1.0:1788587011.939245:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110690688 00000100:00100000:1.0:1788587011.939375:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:1.0:1788587011.939549:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+62:2409:x1875469110690688:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587011.939564:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587011.939589:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ac00/0xfbc93bbea5fda49c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a4a expref: 62 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587011.939606:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587011.939611:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587011.939668:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:2409:x1875469110690688:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 121us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587011.940236:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:0.0:1788587012.149735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587012.149864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110690944 00000100:00100000:1.0:1788587012.149875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110690944 00000100:00100000:1.0:1788587012.149952:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 182 00000100:00100000:1.0:1788587012.149964:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+61:12350:x1875469110690944:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:1.0:1788587012.150089:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587012.150110:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda4b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a51 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.150205:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda4b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.150220:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.150234:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587012.150244:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788587012.150458:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda4b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a51 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.150478:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda4b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a51 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.150487:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587012.150490:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587012.150494:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467800, rc 0) 00000100:00100000:1.0:1788587012.150738:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+63:12350:x1875469110690944:12345-192.168.203.1@tcp:101:cat.0 Request processed in 775us (1009us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788587012.150745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 182 00000100:00080000:3.0:1788587012.151231:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587012.179834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587012.180211:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110691072 00000100:00100000:3.0:1788587012.180220:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110691072 00000100:00100000:3.0:1788587012.180310:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 183 00000100:00100000:3.0:1788587012.180322:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+63:12351:x1875469110691072:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587012.180351:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587012.180372:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a58 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.180474:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1be00/0xfbc93bbea5fda4cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.180489:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1be00/0xfbc93bbea5fda4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.180502:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1be00/0xfbc93bbea5fda4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587012.180768:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788587012.180773:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587012.180794:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1be00/0xfbc93bbea5fda4cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.180821:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a58 expref: 65 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.180839:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1be00/0xfbc93bbea5fda4cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a58 expref: 64 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.180848:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587012.180851:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587012.180854:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1be00, rc 0) 00000100:00100000:3.0:1788587012.180915:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+64:12351:x1875469110691072:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 596us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.180927:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 183 00000100:00100000:0.0:1788587012.188847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587012.188921:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110691456 00000100:00100000:1.0:1788587012.188931:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110691456 00000100:00100000:1.0:1788587012.189094:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:1.0:1788587012.189104:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+64:12351:x1875469110691456:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788587012.189403:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+65:12351:x1875469110691456:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 300us (565us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788587012.189412:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:0.0:1788587012.192878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587012.193533:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110691584 00000100:00100000:2.0:1788587012.193542:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110691584 00000100:00100000:2.0:1788587012.193721:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:2.0:1788587012.193729:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+65:12351:x1875469110691584:12345-192.168.203.1@tcp:103:lfs.0 00010000:00010000:2.0:1788587012.193740:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788587012.193759:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318aa00/0xfbc93bbea5fda45d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a3c expref: 65 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.193799:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda4b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a51 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.193812:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda35a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109f6 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587012.193821:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587012.193826:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587012.193886:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+62:12351:x1875469110691584:12345-192.168.203.1@tcp:103:lfs.0 Request processed in 157us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.193894:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:2.0:1788587012.198966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587012.199384:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110691712 00000100:00100000:3.0:1788587012.199399:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110691712 00000100:00100000:3.0:1788587012.199828:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 184 00000100:00100000:3.0:1788587012.199851:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+62:12351:x1875469110691712:12345-192.168.203.1@tcp:58:lfs.0 00010000:00010000:3.0:1788587012.200051:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.200070:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.200082:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587012.200183:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788587012.200277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+62:12351:x1875469110691712:12345-192.168.203.1@tcp:58:lfs.0 Request processed in 438us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.200285:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 184 00000100:00100000:3.0:1788587012.223202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587012.228386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110691840 00000100:00100000:1.0:1788587012.228401:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110691840 00000100:00100000:0.0:1788587012.229133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 185 00000100:00100000:0.0:1788587012.229145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+62:12353:x1875469110691840:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788587012.229179:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587012.229215:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda4db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a5f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229282:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229297:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229309:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229320:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229328:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229349:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229454:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229468:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229475:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587012.229514:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788587012.229519:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587012.229554:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229574:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229582:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229590:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229597:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229603:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587012.229607:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229615:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229625:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:0.0:1788587012.229628:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587012.229632:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229637:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda4e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229649:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229656:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229668:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229673:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587012.229675:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229681:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229687:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:0.0:1788587012.229690:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587012.229692:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda4e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229722:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda4db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229735:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587012.229741:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:0.0:1788587012.229743:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587012.229745:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5e00, rc 0) 00000100:00100000:0.0:1788587012.229816:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+63:12353:x1875469110691840:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 673us (6622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587012.229832:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 185 00010000:00010000:1.0:1788587012.564628:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587012.948618:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587012.948626:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587012.948672:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788587012.948681:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587012.949133:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127520640:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587012.949859:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b851699c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587012.949969:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127520768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587012.950016:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.950058:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127520768 00000100:00100000:3.0:1788587012.950065:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127520768 00000100:00100000:3.0:1788587012.950104:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587012.950113:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127520768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587012.950141:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788587012.950187:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127520768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.950194:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788587012.950236:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127520768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587012.961217:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83607b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127520640:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587012.968203:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587012.969615:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110691968 00000100:00100000:3.0:1788587012.969627:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110691968 00000100:00100000:3.0:1788587012.969701:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 186 00000100:00100000:3.0:1788587012.969713:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+63:12364:x1875469110691968:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587012.969856:0:10048:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587012.969997:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+63:12364:x1875469110691968:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 285us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.970018:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 186 00000100:00100000:0.0:1788587012.981212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587012.981848:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110692096 00000100:00100000:3.0:1788587012.981860:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110692096 00000100:00100000:3.0:1788587012.981918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 187 00000100:00100000:3.0:1788587012.981928:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+63:12364:x1875469110692096:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788587012.981998:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982016:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982029:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982045:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982053:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982060:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982087:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982097:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.982104:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587012.983027:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788587012.983034:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587012.983049:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983064:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983072:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983079:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983086:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1ba00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587012.983090:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983097:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983109:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:3.0:1788587012.983112:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587012.983117:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983123:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda4f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983133:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983829:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983839:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983844:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587012.983847:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983854:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983865:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8f5b85f9f500) 00010000:00010000:3.0:1788587012.983868:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587012.983871:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983878:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda4fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983895:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983901:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983907:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983912:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1ae00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587012.983922:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983929:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983938:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587012.983941:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587012.983944:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587012.983950:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587012.984045:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+63:12364:x1875469110692096:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 Request processed in 2114us (2838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.984054:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 187 00000100:00100000:1.0:1788587012.993237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587012.993351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110692352 00000100:00100000:1.0:1788587012.993361:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110692352 00000100:00100000:1.0:1788587012.993450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 188 00000100:00100000:1.0:1788587012.993462:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+63:12364:x1875469110692352:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587012.993498:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587012.993522:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda50c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a66 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993630:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993647:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993661:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587012.993673:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788587012.993751:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993760:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993768:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993774:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587012.993783:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993804:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587012.993814:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587012.993820:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993827:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993864:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda50c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a66 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993876:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:1.0:1788587012.993878:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587012.993883:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda50c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a66 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587012.993893:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466000, rc 0) 00000100:00100000:1.0:1788587012.993950:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+64:12364:x1875469110692352:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 490us (721us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788587012.993959:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 188 00000100:00100000:2.0:1788587012.999606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587012.999646:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110692480 00000100:00100000:2.0:1788587012.999656:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110692480 00000100:00100000:2.0:1788587012.999710:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 189 00000100:00100000:2.0:1788587012.999720:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+64:12364:x1875469110692480:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587012.999831:0:10048:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587012.999952:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+64:12364:x1875469110692480:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 233us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587012.999969:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 189 00000040:00080000:1.0:1788587013.002346:0:14654:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587013.002356:0:14654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587013.002402:0:14654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788587013.002408:0:14654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587013.009182:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587013.009219:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110692736 00000100:00100000:1.0:1788587013.009229:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110692736 00000100:00100000:1.0:1788587013.009291:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 190 00000100:00100000:1.0:1788587013.009616:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+64:12364:x1875469110692736:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587013.009639:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587013.009650:0:13553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587013.009678:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1be00/0xfbc93bbea5fda4cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a58 expref: 64 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.009697:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587013.009703:0:13553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587013.009717:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda521 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a6d expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587013.010506:0:13553:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788587013.010653:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.010667:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.010679:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.010729:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda521 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a6d expref: 66 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.010747:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a6d expref: 65 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.010755:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5a83482d00) 00010000:00010000:1.0:1788587013.010758:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587013.010761:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467800, rc 0) 00000100:00100000:1.0:1788587013.010820:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+65:12364:x1875469110692736:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 1209us (1648us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788587013.010841:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 190 00000100:00100000:1.0:1788587013.024129:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.024659:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110692992 00000100:00100000:2.0:1788587013.024670:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110692992 00000100:00100000:2.0:1788587013.024734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 191 00000100:00100000:2.0:1788587013.024754:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+65:12364:x1875469110692992:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587013.024820:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587013.024851:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a6d expref: 65 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.024867:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5a83482d00) 00010000:00010000:2.0:1788587013.024878:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587013.024899:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.024913:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.024923:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.024937:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.024944:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.024950:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025006:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025013:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025019:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025025:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587013.025029:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025036:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025044:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587013.025047:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587013.025051:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025056:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda536 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025064:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025070:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025075:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025086:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587013.025089:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025095:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025103:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x657724d4 (ffff8f5a834bbb00) 00010000:00010000:2.0:1788587013.025105:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587013.025108:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.025114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda53d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x657724d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.025202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+64:12364:x1875469110692992:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 458us (1084us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587013.025210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 191 00000100:00100000:1.0:1788587013.032370:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.032462:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110693120 00000100:00100000:3.0:1788587013.032475:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110693120 00000100:00100000:3.0:1788587013.032539:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 192 00000100:00100000:3.0:1788587013.032551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+64:12364:x1875469110693120:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587013.032571:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587013.032595:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda544 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a74 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.032630:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.032644:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.032669:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.032787:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ae00/0xfbc93bbea5fda544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.032803:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.032812:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:3.0:1788587013.032815:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587013.032818:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1b000, rc 0) 00000100:00100000:3.0:1788587013.032870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+65:12364:x1875469110693120:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 323us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587013.032877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 192 00000100:00100000:1.0:1788587013.041613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587013.041687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110693376 00000100:00100000:0.0:1788587013.041697:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110693376 00000100:00100000:0.0:1788587013.041768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 193 00000100:00100000:0.0:1788587013.041780:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+65:12364:x1875469110693376:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587013.041863:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.041881:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.041893:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587013.042064:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788587013.042075:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358972657935ns, next at 359972655588ns, rc = 0 00000004:00010000:0.0:1788587013.042127:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000182516d reply state 0000000060746773 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.042141:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.042149:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:0.0:1788587013.042152:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788587013.042156:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587013.042260:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:12364:x1875469110693376:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 482us (656us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788587013.042282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 193 00000100:00100000:1.0:1788587013.055987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587013.057044:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110693504 00000100:00100000:0.0:1788587013.057055:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110693504 00000100:00100000:0.0:1788587013.057109:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 194 00000100:00100000:0.0:1788587013.057119:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+67:12364:x1875469110693504:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587013.057141:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587013.057160:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a7b expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.057214:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 68 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.057230:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 68 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.057249:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:0.0:1788587013.057252:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587013.057257:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5200, rc 0) 00000100:00100000:0.0:1788587013.057336:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+68:12364:x1875469110693504:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 209us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.057344:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 194 00000100:00100000:0.0:1788587013.065138:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.066869:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110693632 00000100:00100000:3.0:1788587013.066885:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110693632 00000100:00100000:3.0:1788587013.066958:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:3.0:1788587013.066970:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110693632:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788587013.067197:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110693632:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 230us (2067us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788587013.067205:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00080000:1.0:1788587013.067532:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587013.071166:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.071364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110693888 00000100:00100000:3.0:1788587013.071375:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110693888 00000100:00100000:3.0:1788587013.071465:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:3.0:1788587013.071476:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+68:12364:x1875469110693888:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587013.071702:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+69:12364:x1875469110693888:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 228us (545us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788587013.071710:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:2.0:1788587013.075198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.075269:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110694144 00000100:00100000:3.0:1788587013.075278:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110694144 00000100:00100000:3.0:1788587013.075353:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 195 00000100:00100000:3.0:1788587013.075365:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+69:12364:x1875469110694144:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587013.075519:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+69:12364:x1875469110694144:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 156us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587013.075528:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 195 00000100:00100000:0.0:1788587013.079208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.080501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110694272 00000100:00100000:2.0:1788587013.080514:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110694272 00000100:00100000:2.0:1788587013.080571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 196 00000100:00100000:2.0:1788587013.080581:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+69:12364:x1875469110694272:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587013.080602:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587013.080622:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a82 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.080703:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda567 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.080724:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.080738:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587013.080943:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587013.080964:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda567 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.080991:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a82 expref: 71 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.081008:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a82 expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.081017:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.081020:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587013.081023:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70400, rc 0) 00000100:00100000:2.0:1788587013.081121:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+70:12364:x1875469110694272:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 542us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587013.081129:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 196 00000100:00100000:2.0:1788587013.096520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587013.096730:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110694400 00000100:00100000:0.0:1788587013.096804:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110694400 00000100:00100000:0.0:1788587013.097000:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:0.0:1788587013.097013:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110694400:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587013.097030:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587013.097052:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a89 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587013.097077:0:10047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac05, blocks: 0x0 00010000:00010000:0.0:1788587013.097097:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1788587013.097102:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587013.097112:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 8 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.097130:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 8 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.097143:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5800, rc 0) 00000100:00100000:0.0:1788587013.097209:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110694400:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 198us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.097216:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:0.0:1788587013.103576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587013.103651:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110694656 00000100:00100000:1.0:1788587013.103661:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110694656 00000100:00100000:1.0:1788587013.103724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 197 00000100:00100000:1.0:1788587013.103734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+70:12364:x1875469110694656:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587013.103847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+70:12364:x1875469110694656:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.103855:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 197 00000100:00100000:3.0:1788587013.109613:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.109714:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110694784 00000100:00100000:2.0:1788587013.109724:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110694784 00000100:00100000:2.0:1788587013.109794:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:2.0:1788587013.109810:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:12364:x1875469110694784:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587013.109827:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587013.109852:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a90 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.109884:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.109894:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587013.109898:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587013.109904:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.109941:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.109955:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.109969:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1875469127520896:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587013.110051:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587013.113661:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1875469127520896:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587013.113698:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.113719:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70c00, rc 0) 00000100:00100000:0.0:1788587013.113790:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:12364:x1875469110694784:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 3982us (4185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.113809:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:2.0:1788587013.124500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.124590:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110694912 00000100:00100000:3.0:1788587013.124600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110694912 00010000:00010000:3.0:1788587013.124644:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.124680:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 88 00000100:00100000:3.0:1788587013.124689:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110694912:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587013.124704:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587013.124724:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.124739:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.124793:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d46604ad/0xfbc93bbea5fda56e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a89 expref: 9 pid: 10047 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.124809:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587013.124813:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587013.124820:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.124830:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.124869:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.124883:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1875469127521024:192.168.203.1@tcp:105: 00000100:00100000:3.0:1788587013.124960:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587013.132875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587013.133154:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110695040 00000100:00100000:1.0:1788587013.133164:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110695040 00002000:00100000:1.0:1788587013.133215:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f5a84523b80 x1875469110695040/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:329/0 lens 504/0 e 0 to 0 dl 1788587024 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587013.133228:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a84523b80 with x1875469110695040 ext(0->8) 00002000:00010000:1.0:1788587013.133233:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a84523b80 00000100:00100000:1.0:1788587013.133280:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:1.0:1788587013.133290:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110695040:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788587013.133500:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1875469127521024:192.168.203.1@tcp:105: 00010000:00010000:3.0:1788587013.133524:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587013.133573:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110694912:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 8885us (9082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587013.133584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 88 00000100:00100000:1.0:1788587013.134532:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110695040:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 Request processed in 1239us (1663us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788587013.134542:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 4 00002000:00100000:1.0:1788587013.134559:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f5a84523b80 x1875469110695040/t4294967315(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:329/0 lens 504/448 e 0 to 0 dl 1788587024 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587013.134569:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a84523b80 with x1875469110695040 ext(0->8) 00002000:00010000:1.0:1788587013.134573:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a84523b80 00000100:00100000:2.0:1788587013.136764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587013.136914:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110695168 00000100:00100000:1.0:1788587013.136923:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110695168 00000100:00100000:1.0:1788587013.136981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 198 00000100:00100000:1.0:1788587013.136991:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+70:12364:x1875469110695168:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788587013.139544:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788587013.139564:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788587013.139616:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788587013.139635:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5b84e639c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788587013.139641:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83545300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5b916ddf00 00000020:00080000:2.0:1788587013.139652:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83545800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5a83e82c00 00000100:00100000:2.0:1788587013.139781:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127521152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587013.139848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.140012:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127521152 00000100:00100000:2.0:1788587013.140020:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127521152 00000100:00100000:2.0:1788587013.140163:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587013.140174:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127521152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788587013.140199:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788587013.140352:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bac02, atime: 0x6a9bac02, ctime: 0x6a9bac02, blocks: 0x8 00010000:00010000:2.0:1788587013.140360:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.140377:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1788587013.140382:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587013.140389:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.140405:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.140504:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.140513:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.140540:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587013.140692:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875469127521152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 520us (843us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788587013.140700:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788587013.140727:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788587013.140760:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a84521880/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788587013.140766:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127521152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587013.140990:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+25:12364:x1875469110695168:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 Request processed in 3998us (4230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587013.140999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 198 00010000:00010000:3.0:1788587013.143467:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143482:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143501:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143507:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecca00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143512:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143522:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143539:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f5b85f9f200) 00010000:00010000:3.0:1788587013.143543:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587013.143548:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143555:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecca00/0xfbc93bbea5fda29d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143576:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143583:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143590:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143595:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143598:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143614:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143624:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587013.143627:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587013.143630:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143636:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc400/0xfbc93bbea5fda2a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143652:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143658:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143663:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143669:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143672:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143678:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143687:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9ff00) 00010000:00010000:3.0:1788587013.143690:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587013.143694:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143707:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecc200/0xfbc93bbea5fda2e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143739:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143747:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143753:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143759:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143762:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143767:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143778:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587013.143780:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587013.143784:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143790:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda3e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143802:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143809:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143822:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143827:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecce00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143830:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143837:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143844:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587013.143847:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587013.143849:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143855:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecce00/0xfbc93bbea5fda409 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143866:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143872:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143878:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143883:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318bc00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143885:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143901:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143910:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587013.143912:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587013.143915:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143920:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8318bc00/0xfbc93bbea5fda44f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143933:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143938:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143944:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143949:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587013.143951:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143957:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143964:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:3.0:1788587013.143967:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587013.143969:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.143984:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda552 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.144101:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587013.144108:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.144117:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587013.144121:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.144129:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.144143:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.144151:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f373417/0xfbc93bbea5fda57c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.144169:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587013.144171:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587013.144173:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587013.144179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587013.144196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127521280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788587013.144258:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587013.144313:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127521280 00000100:00100000:3.0:1788587013.144321:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127521280 00000100:00100000:3.0:1788587013.144390:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788587013.144399:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127521280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788587013.144531:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788587013.144535:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587013 00002000:00010000:3.0:1788587013.144538:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788587013.144540:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788587013 -> 1788587013 00002000:00010000:3.0:1788587013.144542:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788587013.144589:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127521280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (331us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788587013.144597:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788587013.144621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788587013.144635:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a83f18e00/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788587013.144643:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127521280:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788587013.145436:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788587013.145491:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788587013.148561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587013.148624:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110695296 00000100:00100000:0.0:1788587013.148634:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110695296 00000100:00100000:0.0:1788587013.148693:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:0.0:1788587013.148709:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:2408:x1875469110695296:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788587013.153741:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788587013.153757:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788587013.154686:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110695296:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 Request processed in 5971us (6126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.154697:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:3.0:1788587013.159492:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.159581:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110695552 00000100:00100000:2.0:1788587013.159592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110695552 00000100:00100000:2.0:1788587013.159659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 199 00000100:00100000:2.0:1788587013.159682:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+19:12364:x1875469110695552:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587013.159733:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587013.159759:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda567 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a82 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.159777:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.159789:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587013.159823:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.159836:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.159846:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587013.159966:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9b0574 reply state 000000008e2afa84 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.159979:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.159986:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.159988:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587013.159991:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587013.160085:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+20:12364:x1875469110695552:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 417us (603us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788587013.160092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 199 00000100:00100000:2.0:1788587013.161734:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587013.162066:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110695680 00000100:00100000:0.0:1788587013.162075:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110695680 00000100:00100000:0.0:1788587013.162126:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:0.0:1788587013.162135:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110695680:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788587013.162281:0:10047:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788587013.162285:0:10047:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788587013 -> 1788587011 00002000:00010000:0.0:1788587013.162288:0:10047:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788587010 00002000:00010000:0.0:1788587013.162290:0:10047:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788587013 -> 1788587011 00002000:00010000:0.0:1788587013.162292:0:10047:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788587013.162354:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110695680:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 219us (626us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788587013.162361:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:3.0:1788587013.164292:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587013.165734:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110695936 00000100:00100000:0.0:1788587013.165746:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110695936 00000100:00100000:0.0:1788587013.165821:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 200 00000100:00100000:0.0:1788587013.165841:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+20:12364:x1875469110695936:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587013.165910:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.165927:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.165937:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.165974:0:13553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.165988:0:13553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 20 pid: 6520 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587013.166002:0:13553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127521408:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587013.166085:0:13553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9869a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587013.183689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.183751:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696064 00000100:00100000:2.0:1788587013.183760:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696064 00000100:00100000:1.0:1788587013.183776:0:13553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13553:1875469127521408:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587013.183799:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 21 pid: 6520 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.183799:0:13553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.183841:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 89 00000100:00100000:2.0:1788587013.183850:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+21:2409:x1875469110696064:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587013.183885:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587013.183893:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 21 pid: 6520 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.183905:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 21 pid: 6520 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.183925:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b000/0xfbc93bbea5fda54b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a74 expref: 21 pid: 6520 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.183939:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.183943:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.183953:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.183960:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.183985:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587013.184035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+20:2409:x1875469110696064:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 185us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587013.184042:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 89 00010000:00010000:1.0:1788587013.184443:0:13553:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184452:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184490:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184498:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184505:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184512:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587013.184516:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184532:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184543:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:1.0:1788587013.184546:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587013.184550:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.184556:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda58a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587013.184614:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+19:12364:x1875469110695936:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 Request processed in 18775us (20328us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587013.184623:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 200 00000100:00100000:0.0:1788587013.189812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.190515:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696192 00000100:00100000:3.0:1788587013.190525:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696192 00000100:00100000:3.0:1788587013.190664:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:3.0:1788587013.190675:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2406:x1875469110696192:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788587013.190721:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.190740:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.190750:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587013.190754:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587013.190758:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.190804:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.190818:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 8 pid: 8436 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.190831:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127521536:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587013.191070:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587013.210967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.211147:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127521536:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587013.211173:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.211391:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696320 00000100:00100000:2.0:1788587013.211398:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696320 00010000:00010000:2.0:1788587013.211457:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 9 pid: 8436 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.211500:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 90 00000100:00100000:2.0:1788587013.211509:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110696320:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587013.211523:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587013.211544:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 9 pid: 8436 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.211557:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 9 pid: 8436 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.211579:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad269d29/0xfbc93bbea5fda575 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a90 expref: 9 pid: 8436 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.211593:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587013.211597:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587013.211603:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.211612:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.211640:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587013.211688:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110696320:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 180us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587013.211696:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 90 00010000:00010000:0.0:1788587013.212159:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212169:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212189:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212204:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212221:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212227:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1ae00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587013.212231:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212239:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212250:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587013.212256:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b8a0de/0xfbc93bbea5fda591 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587013.212310:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2406:x1875469110696192:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 Request processed in 21637us (22506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.212318:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:0.0:1788587013.221629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.221756:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696576 00000100:00100000:3.0:1788587013.221766:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696576 00000100:00100000:3.0:1788587013.221832:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 201 00000100:00100000:3.0:1788587013.221842:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:12364:x1875469110696576:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788587013.221927:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.221944:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.221954:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.221999:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.222013:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 19 pid: 6522 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.222028:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127521664:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587013.222122:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587013.230697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.230723:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696704 00000100:00100000:2.0:1788587013.230731:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696704 00010000:00010000:2.0:1788587013.230766:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 20 pid: 6522 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.230802:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 91 00000100:00100000:2.0:1788587013.230811:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+20:2408:x1875469110696704:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587013.230838:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587013.230845:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 20 pid: 6522 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.230865:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 20 pid: 6522 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.230888:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587013.230892:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.230904:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.230912:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.230931:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587013.230977:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+20:2408:x1875469110696704:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 167us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587013.230985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 91 00010000:00010000:3.0:1788587013.233701:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd600/0xfbc93bbea5fda3df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a19 expref: 19 pid: 6522 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.233728:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127521664:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587013.233751:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.233761:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.233769:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.236338:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.236365:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 19 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.236375:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.236438:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 19 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.236452:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 19 pid: 10048 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.236466:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127521792:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587013.236552:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587013.247519:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127521792:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587013.247550:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.247647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587013.247677:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696832 00000100:00100000:2.0:1788587013.247683:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696832 00010000:00010000:2.0:1788587013.247722:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 20 pid: 10048 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.247756:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 92 00000100:00100000:2.0:1788587013.247765:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+20:2409:x1875469110696832:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587013.247780:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587013.247788:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 20 pid: 10048 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247801:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 20 pid: 10048 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247825:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda559 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a7b expref: 20 pid: 10048 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247842:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.247847:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247856:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247877:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247899:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587013.247951:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:2409:x1875469110696832:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 186us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587013.247958:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 92 00010000:00010000:2.0:1788587013.247984:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.247991:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587013.248095:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788587013.248203:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788587013.248242:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788587013.248319:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875469127521920:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587013.252114:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.252148:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587013.253837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127521920 00000100:00100000:0.0:1788587013.253850:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127521920 00000100:00100000:0.0:1788587013.253927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788587013.253938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875469127521920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788587013.254074:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875469127521920:12345-0@lo:1000:mdt00_001.0 Request processed in 139us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.254082:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788587013.254137:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788587013.254143:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a83f18e00, transno 4294967316 00000100:00100000:2.0:1788587013.254165:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875469127521920:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788587013.254317:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788587013.254405:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875469127522048:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788587013.254463:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.254486:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587013.254809:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522048 00000100:00100000:1.0:1788587013.254814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522048 00000100:00100000:1.0:1788587013.255086:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788587013.255096:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875469127522048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788587013.255231:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1875469127522048:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (767us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788587013.255238:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788587013.255254:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1875469127522048:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788587013.255302:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255317:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255338:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255344:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587013.255349:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255357:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255373:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.255377:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587013.255382:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255389:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b200/0xfbc93bbea5fda59f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255409:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255436:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255442:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255457:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587013.255461:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255468:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255476:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:2.0:1788587013.255479:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587013.255481:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255487:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda4d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255508:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255523:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255533:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255556:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.255569:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 22 pid: 6521 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587013.255590:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127522176:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587013.255645:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587013.263144:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.263316:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110696960 00000100:00100000:3.0:1788587013.263339:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110696960 00010000:00010000:3.0:1788587013.263391:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 23 pid: 6521 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587013.263466:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 93 00000100:00100000:3.0:1788587013.263477:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+23:2408:x1875469110696960:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587013.263493:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587013.263500:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 23 pid: 6521 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.263514:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 23 pid: 6521 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.263538:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:3.0:1788587013.263545:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.263575:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.263584:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.263605:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587013.263666:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+23:2408:x1875469110696960:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 190us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587013.263674:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 93 00010000:00010000:0.0:1788587013.264631:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda4f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a5f expref: 22 pid: 6521 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587013.264651:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1875469127522176:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587013.264674:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264742:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264750:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264763:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264782:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264788:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264795:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587013.264799:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264806:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264820:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587013.264822:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587013.264826:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264832:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264843:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264849:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264855:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264860:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1ba00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587013.264869:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264876:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264884:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5a834bbf00) 00010000:00010000:1.0:1788587013.264887:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587013.264890:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587013.264896:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1ba00/0xfbc93bbea5fda598 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587013.265069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+21:12364:x1875469110696576:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 43226us (43446us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788587013.265080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 201 00000020:00080000:1.0:1788587013.265085:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788587013.265388:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587013.265393:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587013.265889:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788587013.265900:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587013.274007:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587013.274288:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110697216 00000100:00100000:3.0:1788587013.274299:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110697216 00000100:00100000:3.0:1788587013.274378:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:3.0:1788587013.274389:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+21:12364:x1875469110697216:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788587013.274687:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788587013.274719:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788587013.274753:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.274769:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.274782:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.274808:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.274815:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.274822:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587013.274844:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587013.274929:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+23:12364:x1875469110697216:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 540us (930us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788587013.274937:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 50 00000020:00080000:3.0:1788587013.274943:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587013.274954:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587013.274963:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.274972:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587013.274977:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.274987:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.275002:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:2.0:1788587013.275006:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587013.275011:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.275018:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda5ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587013.275031:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587013.275033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587013.275035:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587013.464553:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127522560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.464627:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587013.464692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127523072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.464721:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587013.464738:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127523584:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.464783:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587013.464811:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788587013.464817:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127522432:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.464853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587013.464871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127522944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.464891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587013.464911:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127523456:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.464931:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587013.464973:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127523584 00000100:00100000:0.0:1788587013.464980:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127523584 00000100:00100000:0.0:1788587013.465036:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788587013.465045:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127523584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465294:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127523072 00000100:00100000:1.0:1788587013.465299:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127523072 00000100:00100000:1.0:1788587013.465339:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522432 00000100:00100000:1.0:1788587013.465343:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522432 00000100:00100000:1.0:1788587013.465355:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522944 00000100:00100000:1.0:1788587013.465358:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522944 00000100:00100000:1.0:1788587013.465368:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127523456 00000100:00100000:1.0:1788587013.465370:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127523456 00000100:00100000:1.0:1788587013.465384:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788587013.465391:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465465:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127523072:12345-0@lo:400:kworker.0 Request processed in 74us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.465472:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788587013.465496:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788587013.465502:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127522432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465530:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127522432:12345-0@lo:400:kworker.0 Request processed in 29us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.465536:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788587013.465546:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788587013.465552:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127522944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465576:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127522944:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.465582:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788587013.465591:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788587013.465597:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127523456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465622:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127523456:12345-0@lo:400:kworker.0 Request processed in 25us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.465627:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788587013.465696:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127522432:0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127522944:0@lo:400:kworker.0 00010000:00080000:1.0:1788587013.465719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84529c00 x1875469127523456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587013.465729:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127523456:0@lo:400:kworker.0 00010000:00080000:1.0:1788587013.465739:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a8452bb80 x1875469127523072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587013.465747:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127523072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465811:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522560 00000100:00100000:1.0:1788587013.465815:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522560 00000100:00100000:1.0:1788587013.465840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788587013.465847:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.465887:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127522560:12345-0@lo:400:kworker.0 Request processed in 41us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.465893:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788587013.465916:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127522560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587013.466642:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127523584:12345-0@lo:400:kworker.0 Request processed in 1595us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587013.466652:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788587013.466876:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127523584:0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.468693:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127522304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.468772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.468856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127522816:0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.468862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522304 00000100:00100000:1.0:1788587013.468871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522304 00000100:00100000:2.0:1788587013.468888:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587013.468920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788587013.468927:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127523328:0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.468933:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.468962:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587013.468994:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127522304:12345-0@lo:400:kworker.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.469002:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788587013.469015:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127522304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.469033:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788587013.469041:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127522688:0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.469067:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.469087:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127523200:0@lo:400:kworker.0 00000100:00080000:3.0:1788587013.469140:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587013.469146:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587013.469149:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587013.469153:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127523328 00000100:00100000:1.0:1788587013.469159:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127523328 00000100:00100000:3.0:1788587013.469171:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522688 00000100:00100000:3.0:1788587013.469178:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522688 00000100:00100000:1.0:1788587013.469206:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788587013.469219:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788587013.469220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127523328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587013.469233:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127522688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.469262:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127523328:12345-0@lo:400:kworker.0 Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.469270:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788587013.469284:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127522688:12345-0@lo:400:kworker.0 Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587013.469293:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788587013.469295:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127522816 00000100:00100000:1.0:1788587013.469300:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127522816 00000100:00080000:3.0:1788587013.469318:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587013.469340:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788587013.469356:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127522816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.469391:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127522816:12345-0@lo:400:kworker.0 Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.469397:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788587013.469507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587013.469537:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127522816:0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.469559:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127523328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587013.469575:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127522688:0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.469605:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127523200 00000100:00100000:1.0:1788587013.469610:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127523200 00000100:00100000:1.0:1788587013.469662:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788587013.469668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127523200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587013.469702:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127523200:12345-0@lo:400:kworker.0 Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00080000:3.0:1788587013.469910:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587013.469946:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788587013.470866:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127523200:0@lo:400:kworker.0 00010000:00010000:1.0:1788587013.589170:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587014.612853:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587014.881763:0:14706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587014.881771:0:14706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587014.881800:0:14706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788587014.881806:0:14706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587015.002857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.002981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110697472 00000100:00100000:1.0:1788587015.002991:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110697472 00000100:00100000:1.0:1788587015.003063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 202 00000100:00100000:1.0:1788587015.003084:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+23:12382:x1875469110697472:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587015.003109:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788587015.003124:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587015.003131:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda5b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a97 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.003236:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda5bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.003252:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda5bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.003271:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda5bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587015.003283:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788587015.003397:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda5b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a97 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.003434:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda5bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a97 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.003443:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587015.003446:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587015.003450:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467400, rc 0) 00000100:00100000:1.0:1788587015.003513:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+25:12382:x1875469110697472:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 441us (665us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788587015.003520:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 202 00000100:00100000:1.0:1788587015.009183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.010199:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110697600 00000100:00100000:2.0:1788587015.010210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110697600 00000100:00100000:2.0:1788587015.010275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 203 00000100:00100000:2.0:1788587015.010286:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+25:12382:x1875469110697600:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:2.0:1788587015.010372:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010390:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010403:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010449:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010457:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010464:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010541:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010548:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010555:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587015.010599:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010613:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010619:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010626:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010632:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587015.010636:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010664:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010678:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587015.010681:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587015.010686:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010693:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71a00/0xfbc93bbea5fda5c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010707:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010713:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010718:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010722:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587015.010725:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010743:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010750:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b83c9c200) 00010000:00010000:2.0:1788587015.010752:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587015.010755:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010772:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda5d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010787:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010793:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010799:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010804:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587015.010807:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010813:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010820:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b83c9cc00) 00010000:00010000:2.0:1788587015.010822:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587015.010825:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.010831:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda5d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.011302:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+25:12382:x1875469110697600:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 1015us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.011312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 203 00000100:00100000:3.0:1788587015.055196:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.056291:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110697856 00000100:00100000:3.0:1788587015.056303:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110697856 00000100:00100000:3.0:1788587015.056374:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 204 00000100:00100000:3.0:1788587015.056385:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+25:12385:x1875469110697856:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587015.056404:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587015.056538:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda5de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810a9e expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056604:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056619:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056631:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056645:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056652:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056658:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056976:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.056990:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057012:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587015.057023:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788587015.057244:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057253:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057261:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057267:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1bc00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.057271:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057486:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057503:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587015.057505:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.057511:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057518:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda5e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057529:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057534:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057546:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057551:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.057554:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057560:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057567:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:3.0:1788587015.057570:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.057572:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057578:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda5ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057618:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda5de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 28 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057630:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 27 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.057637:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.057639:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587015.057641:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1aa00, rc 0) 00000100:00100000:3.0:1788587015.057703:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+27:12385:x1875469110697856:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1320us (2515us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788587015.057730:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 204 00000100:00100000:3.0:1788587015.061150:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.061198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110697984 00000100:00100000:3.0:1788587015.061208:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110697984 00000100:00100000:3.0:1788587015.061260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 205 00000100:00100000:3.0:1788587015.061269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+27:12385:x1875469110697984:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:3.0:1788587015.061342:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061358:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061370:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061403:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061411:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061727:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061734:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.061738:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061746:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061771:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.061774:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587015.061779:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.061785:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda601 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.061849:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+27:12385:x1875469110697984:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 580us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.061857:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 205 00000100:00100000:3.0:1788587015.063888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.063971:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110698240 00000100:00100000:0.0:1788587015.063981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110698240 00000100:00100000:0.0:1788587015.064042:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:0.0:1788587015.064055:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+27:12385:x1875469110698240:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:0.0:1788587015.064284:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+28:12385:x1875469110698240:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 230us (404us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788587015.064292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:3.0:1788587015.124236:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.124327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110698496 00000100:00100000:2.0:1788587015.124337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110698496 00000100:00100000:2.0:1788587015.124410:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 206 00000100:00100000:2.0:1788587015.124453:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+28:11910:x1875469110698496:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587015.124479:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587015.124500:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda608 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810aa5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.124604:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.124617:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 29 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.124626:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.124656:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 29 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.124667:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 29 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.124678:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127523712:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587015.124770:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587015.136668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.139492:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110698624 00000100:00100000:3.0:1788587015.139508:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110698624 00010000:00010000:3.0:1788587015.139563:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 30 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.139613:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 94 00000100:00100000:3.0:1788587015.139624:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:2409:x1875469110698624:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587015.139638:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587015.139645:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 30 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.139664:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 30 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.139688:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.139707:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.139717:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.139724:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.139746:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587015.139809:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:2409:x1875469110698624:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 187us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.139817:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 94 00010000:00010000:2.0:1788587015.140589:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda5f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a9e expref: 29 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.140612:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127523712:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587015.140646:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.140657:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.140663:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587015.140683:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788587015.140807:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda608 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.140824:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.140832:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587015.140835:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587015.140838:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71600, rc 0) 00000100:00100000:2.0:1788587015.140874:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+29:11910:x1875469110698496:12345-192.168.203.1@tcp:101:bash.0 Request processed in 16424us (16647us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788587015.140882:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 206 00000100:00100000:1.0:1788587015.148617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.148910:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110698752 00000100:00100000:3.0:1788587015.148919:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110698752 00000100:00100000:3.0:1788587015.148980:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 207 00000100:00100000:3.0:1788587015.148989:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+29:11910:x1875469110698752:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788587015.149011:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587015.149031:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda61d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810aac expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.149062:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda624 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.149075:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.149085:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.149196:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda61d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aac expref: 31 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.149220:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aac expref: 30 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.149228:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.149231:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587015.149235:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1a000, rc 0) 00000100:00100000:3.0:1788587015.149297:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+30:11910:x1875469110698752:12345-192.168.203.1@tcp:101:bash.0 Request processed in 309us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.149305:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 207 00000100:00100000:1.0:1788587015.152496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.152545:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699008 00000100:00100000:3.0:1788587015.152556:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699008 00000100:00100000:3.0:1788587015.152612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 208 00000100:00100000:3.0:1788587015.152622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:11910:x1875469110699008:12345-192.168.203.1@tcp:36:bash.0 00010000:00010000:3.0:1788587015.153104:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.153122:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.153134:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587015.153179:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788587015.153201:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000115789ff reply state 0000000031a97f1e transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.153212:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.153245:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.153248:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587015.153253:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788587015.153610:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1788587015.153723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+34:11910:x1875469110699008:12345-192.168.203.1@tcp:36:bash.0 Request processed in 1099us (1245us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788587015.153730:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 208 00000020:00080000:3.0:1788587015.153736:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788587015.162957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.163113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699136 00000100:00100000:3.0:1788587015.163123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699136 00000100:00100000:3.0:1788587015.163186:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 209 00000100:00100000:3.0:1788587015.163197:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+34:11910:x1875469110699136:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:3.0:1788587015.163218:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587015.163237:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda632 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ab3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.163632:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda632 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ab3 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.163650:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda632 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ab3 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.163687:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587015.163691:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587015.163695:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1a800, rc 0) 00000100:00100000:2.0:1788587015.163759:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+35:11910:x1875469110699136:12345-192.168.203.1@tcp:101:bash.0 Request processed in 563us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.163766:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 209 00000100:00100000:1.0:1788587015.172066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.172177:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699264 00000100:00100000:0.0:1788587015.172187:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699264 00000100:00100000:0.0:1788587015.172257:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:0.0:1788587015.172266:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:11910:x1875469110699264:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:0.0:1788587015.172283:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587015.172304:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810aba expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587015.172340:0:10047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bac03, atime: 0x6a9bac02, ctime: 0x6a9bac03, blocks: 0x8 00010000:00010000:0.0:1788587015.172363:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788587015.172368:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587015.172377:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.172458:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 8 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.172475:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5e00, rc 0) 00000100:00080000:3.0:1788587015.172788:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587015.172828:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+8:11910:x1875469110699264:12345-192.168.203.1@tcp:101:bash.0 Request processed in 562us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587015.172836:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:1.0:1788587015.181767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.182006:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699392 00000100:00100000:2.0:1788587015.182017:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699392 00002000:00010000:2.0:1788587015.182062:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788587015.182066:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83f89180 with x1875469110699392 ext(0->18446744073709551615) 00002000:00010000:2.0:1788587015.182085:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83f89180. 00000100:00100000:2.0:1788587015.182122:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:2.0:1788587015.182132:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110699392:12345-192.168.203.1@tcp:10:bash.0 00002000:00010000:2.0:1788587015.182395:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788587015.182399:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788587011 -> 1788587015 00002000:00010000:2.0:1788587015.182401:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788587010 -> 1788587010 00002000:00010000:2.0:1788587015.182403:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788587011 -> 1788587015 00002000:00010000:2.0:1788587015.182405:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788587015.182489:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2408:x1875469110699392:12345-192.168.203.1@tcp:10:bash.0 Request processed in 358us (730us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788587015.182496:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 5 00002000:00010000:2.0:1788587015.182499:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788587015.182502:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83f89180 with x1875469110699392 ext(0->18446744073709551615) 00002000:00010000:2.0:1788587015.182506:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83f89180. 00000100:00100000:2.0:1788587015.256647:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.256752:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699520 00000100:00100000:1.0:1788587015.256761:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699520 00000100:00100000:1.0:1788587015.256818:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 210 00000100:00100000:1.0:1788587015.256828:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+35:12399:x1875469110699520:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:1.0:1788587015.256897:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.256920:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.256931:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.256947:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.256954:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.256960:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257044:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257053:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257059:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587015.257100:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257109:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257115:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257143:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257148:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.257152:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257159:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257170:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587015.257173:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.257178:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257184:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda640 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257197:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257203:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257208:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257213:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.257215:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257242:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257251:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5a83482000) 00010000:00010000:1.0:1788587015.257253:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.257256:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257261:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda647 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257276:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257282:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257286:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257291:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.257294:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257300:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257306:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:1.0:1788587015.257309:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.257312:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.257336:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467200/0xfbc93bbea5fda64e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.257473:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+35:12399:x1875469110699520:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 588us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.257482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 210 00000100:00100000:1.0:1788587015.304251:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.307030:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699776 00000100:00100000:3.0:1788587015.307046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699776 00000100:00100000:3.0:1788587015.307186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 211 00000100:00100000:3.0:1788587015.307197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+35:12403:x1875469110699776:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587015.307216:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587015.307236:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda655 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ac1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307306:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307352:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307375:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307391:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307397:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307403:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307528:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b800/0xfbc93bbea5fda66a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307538:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b800/0xfbc93bbea5fda66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307546:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b800/0xfbc93bbea5fda66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587015.307554:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788587015.307625:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307633:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307640:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307651:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.307656:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307664:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307675:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587015.307678:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.307683:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307689:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda65c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307705:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307710:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307715:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307720:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.307723:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307729:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307747:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:3.0:1788587015.307749:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.307752:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307758:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307797:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda655 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ac1 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307811:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b800/0xfbc93bbea5fda66a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ac1 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.307818:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.307821:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788587015.307823:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1b800, rc 0) 00000100:00100000:3.0:1788587015.307900:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+37:12403:x1875469110699776:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 705us (3657us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788587015.307907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 211 00000100:00100000:3.0:1788587015.312584:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.316047:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110699904 00000100:00100000:2.0:1788587015.316062:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110699904 00000100:00100000:2.0:1788587015.316170:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 212 00000100:00100000:2.0:1788587015.316182:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+37:12403:x1875469110699904:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:2.0:1788587015.316247:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.316264:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.316274:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.316310:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.316332:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 37 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.316347:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127523840:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587015.316464:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587015.320890:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.320924:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110700160 00000100:00100000:2.0:1788587015.320932:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110700160 00000100:00100000:2.0:1788587015.320983:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:2.0:1788587015.320993:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+38:6174:x1875469110700160:12345-192.168.203.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587015.321250:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+39:6174:x1875469110700160:12345-192.168.203.1@tcp:35:ldlm_bl.0 Request processed in 257us (368us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788587015.321271:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:0.0:1788587015.321513:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127523840:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587015.321537:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.325410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.326620:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110700288 00000100:00100000:2.0:1788587015.326631:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110700288 00010000:00010000:2.0:1788587015.326676:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 39 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.326723:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 95 00000100:00100000:2.0:1788587015.326733:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+39:2408:x1875469110700288:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587015.326747:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587015.326754:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 39 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.326766:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 39 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.326786:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71600/0xfbc93bbea5fda60f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aa5 expref: 39 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.326804:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587015.326809:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.326818:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.326825:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.326888:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587015.326957:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+38:2408:x1875469110700288:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 224us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.326964:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 95 00010000:00010000:1.0:1788587015.327234:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327243:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327280:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327289:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327296:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327301:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.327305:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327320:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327331:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:1.0:1788587015.327340:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587015.327344:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.327358:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda678 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.327412:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+37:12403:x1875469110699904:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 11231us (14835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.327466:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 212 00000100:00100000:3.0:1788587015.330188:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.331205:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110700544 00000100:00100000:2.0:1788587015.331217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110700544 00000100:00100000:2.0:1788587015.331272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:2.0:1788587015.331282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+37:12403:x1875469110700544:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:2.0:1788587015.331537:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+38:12403:x1875469110700544:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 255us (1369us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788587015.331544:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:2.0:1788587015.427897:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.428009:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110700800 00000100:00100000:3.0:1788587015.428020:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110700800 00000100:00100000:3.0:1788587015.428078:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 213 00000100:00100000:3.0:1788587015.428088:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+38:12414:x1875469110700800:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:3.0:1788587015.428128:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587015.428150:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda67f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ac8 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428222:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428248:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428260:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428274:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428282:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428288:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428400:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda694 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428409:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428668:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587015.428679:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788587015.428763:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428772:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428779:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428784:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.428789:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428795:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428807:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587015.428811:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.428815:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428820:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda686 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428832:0:13553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428838:0:13553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428844:0:13553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428859:0:13553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.428862:0:13553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428868:0:13553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428876:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:3.0:1788587015.428879:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.428881:0:13553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428887:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428933:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda67f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ac8 expref: 41 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428947:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ac8 expref: 40 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.428954:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.428956:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587015.428958:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1aa00, rc 0) 00000100:00100000:3.0:1788587015.429036:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+40:12414:x1875469110700800:12345-192.168.203.1@tcp:101:cat.0 Request processed in 949us (1149us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788587015.429044:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 213 00000100:00100000:3.0:1788587015.434599:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.434878:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110701056 00000100:00100000:2.0:1788587015.434888:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110701056 00000100:00100000:2.0:1788587015.434988:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:2.0:1788587015.435290:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+40:12414:x1875469110701056:12345-192.168.203.1@tcp:35:cat.0 00000100:00100000:2.0:1788587015.435688:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+41:12414:x1875469110701056:12345-192.168.203.1@tcp:35:cat.0 Request processed in 400us (1095us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788587015.435696:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:1.0:1788587015.452311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.452460:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110701312 00000100:00100000:3.0:1788587015.452471:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110701312 00000100:00100000:3.0:1788587015.452530:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 214 00000100:00100000:3.0:1788587015.452541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+41:12415:x1875469110701312:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:3.0:1788587015.452599:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788587015.452626:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a800/0xfbc93bbea5fda632 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ab3 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452649:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1aa00/0xfbc93bbea5fda694 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ac8 expref: 40 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452662:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b800/0xfbc93bbea5fda66a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ac1 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452673:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a000/0xfbc93bbea5fda624 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aac expref: 38 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.452689:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587015.452708:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452722:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452732:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452745:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452766:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452773:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452847:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452855:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.452861:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587015.453056:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788587015.453066:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361383649527ns, next at 362383647164ns, rc = 0 00010000:00010000:3.0:1788587015.453111:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453120:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453127:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453134:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453141:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453157:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453186:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587015.453205:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453211:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453218:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453224:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.453240:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453249:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453259:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:3.0:1788587015.453262:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788587015.453266:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453272:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda6b0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453287:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453293:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453305:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453311:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1bc00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.453324:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453331:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453340:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:3.0:1788587015.453343:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587015.453346:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453352:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda6a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587015.453362:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004707109a reply state 00000000c63d6456 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453373:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.453378:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:3.0:1788587015.453381:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587015.453383:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587015.453509:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+39:12415:x1875469110701312:12345-192.168.203.1@tcp:36:rm.0 Request processed in 970us (1207us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788587015.453517:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 214 00010000:00010000:2.0:1788587015.454116:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587015.454125:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.454131:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587015.454135:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.454153:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.454165:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:2.0:1788587015.454167:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587015.454170:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.454177:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b400/0xfbc93bbea5fda6b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.454189:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587015.454191:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587015.454193:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587015.502626:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.502790:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110701568 00000100:00100000:1.0:1788587015.502801:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110701568 00000100:00100000:1.0:1788587015.502867:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 215 00000100:00100000:1.0:1788587015.502877:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+39:12421:x1875469110701568:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788587015.502903:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587015.502927:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda6be lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810acf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503057:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503073:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503084:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503094:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503121:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503128:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587015.503505:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788587015.503646:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503656:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503664:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503697:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503704:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503711:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503717:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.503721:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503729:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503753:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587015.503756:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.503762:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503768:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587015.503781:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5a7bca6 reply state 00000000ce9ce6e5 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503792:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503798:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:1.0:1788587015.503801:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587015.503804:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587015.503832:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466000/0xfbc93bbea5fda6be lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503846:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.503853:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:1.0:1788587015.503855:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587015.503857:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467600, rc 0) 00000100:00100000:1.0:1788587015.503929:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+42:12421:x1875469110701568:12345-192.168.203.1@tcp:101:bash.0 Request processed in 1053us (1314us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788587015.503936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 215 00000100:00100000:3.0:1788587015.507529:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.509674:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127523968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587015.509740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587015.509873:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127523968 00000100:00100000:3.0:1788587015.509882:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127523968 00000100:00100000:3.0:1788587015.509943:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788587015.509952:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127523968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587015.509981:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788587015.510023:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127523968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.510030:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788587015.510097:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587015.510144:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127523968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587015.512658:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587015.512682:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127524096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587015.512745:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587015.512801:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127524096 00000100:00100000:0.0:1788587015.512808:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127524096 00000100:00100000:0.0:1788587015.512865:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788587015.512873:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127524096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587015.512894:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788587015.512937:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127524096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587015.512944:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788587015.512965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587015.512998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127524096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587015.513205:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110701696 00000100:00100000:1.0:1788587015.513209:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110701696 00000100:00100000:1.0:1788587015.513305:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:1.0:1788587015.513323:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110701696:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788587015.513334:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587015.513356:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ad6 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587015.513379:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587015.513396:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1788587015.513400:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587015.513409:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.513450:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.513463:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467200, rc 0) 00000100:00100000:1.0:1788587015.513513:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110701696:12345-192.168.203.1@tcp:101:bash.0 Request processed in 200us (5992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.513520:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00080000:0.0:1788587015.517543:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587015.520971:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.521071:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110701824 00000100:00100000:2.0:1788587015.521084:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110701824 00000100:00100000:2.0:1788587015.521140:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 68 00000100:00100000:2.0:1788587015.521151:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+8:12421:x1875469110701824:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587015.521167:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587015.521185:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810add expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.521216:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.521256:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587015.521260:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587015.521267:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.521302:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.521325:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 9 pid: 8434 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.521352:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1875469127524224:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587015.521489:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587015.530975:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.531094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110701952 00000100:00100000:0.0:1788587015.531104:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110701952 00010000:00010000:0.0:1788587015.531144:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 10 pid: 8434 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587015.531194:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 96 00000100:00100000:0.0:1788587015.531204:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110701952:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587015.531220:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587015.531243:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 10 pid: 8434 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.531259:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 10 pid: 8434 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.531297:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587015.531302:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587015.531321:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.531333:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.531371:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587015.531404:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1875469127524352:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788587015.531470:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2440f24/0xfbc93bbea5fda6e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ad6 expref: 10 pid: 8434 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.531490:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1875469127524224:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587015.531518:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587015.531522:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788587015.531534:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71600, rc 0) 00000100:00100000:2.0:1788587015.531571:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+9:12421:x1875469110701824:12345-192.168.203.1@tcp:101:bash.0 Request processed in 10421us (10609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.531590:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 68 00000100:00100000:0.0:1788587015.540543:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6507:1875469127524352:192.168.203.1@tcp:105: 00010000:00010000:0.0:1788587015.540568:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587015.540627:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110701952:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 9423us (9660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587015.540638:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 96 00000100:00100000:3.0:1788587015.542487:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.542521:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110702208 00000100:00100000:0.0:1788587015.542531:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110702208 00000100:00100000:0.0:1788587015.542589:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:0.0:1788587015.542600:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+42:12421:x1875469110702208:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:0.0:1788587015.542876:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+43:12421:x1875469110702208:12345-192.168.203.1@tcp:35:bash.0 Request processed in 277us (397us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788587015.542884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 55 00010000:00010000:1.0:1788587015.637025:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587015.714186:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.714476:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110702336 00000100:00100000:2.0:1788587015.714488:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110702336 00000100:00100000:2.0:1788587015.714548:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 216 00000100:00100000:2.0:1788587015.714568:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+43:12437:x1875469110702336:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587015.714592:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587015.714612:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda6ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ae4 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.714678:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda6f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.714692:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.714704:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587015.714747:0:13553:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788587015.714751:0:13553:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587015.714770:0:13553:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.714795:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda6ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ae4 expref: 45 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.714815:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ae4 expref: 44 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.714843:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587015.714846:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587015.714850:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70600, rc 0) 00000100:00100000:2.0:1788587015.714972:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+44:12437:x1875469110702336:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 404us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.714979:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 216 00000100:00100000:3.0:1788587015.730059:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.733529:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110702592 00000100:00100000:1.0:1788587015.733547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110702592 00000100:00100000:1.0:1788587015.733744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 217 00000100:00100000:1.0:1788587015.733757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+44:12437:x1875469110702592:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587015.733777:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587015.733821:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810aeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.733941:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.733955:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.733968:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587015.733978:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788587015.734086:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda6fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aeb expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.734107:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aeb expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.734117:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:1.0:1788587015.734120:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587015.734123:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467800, rc 0) 00000100:00100000:1.0:1788587015.734194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+46:12437:x1875469110702592:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 440us (4143us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788587015.734200:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 217 00000100:00100000:3.0:1788587015.737555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.737710:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110702848 00000100:00100000:2.0:1788587015.737721:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110702848 00000100:00100000:2.0:1788587015.737800:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:2.0:1788587015.737810:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+46:2408:x1875469110702848:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587015.737826:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587015.737853:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467800/0xfbc93bbea5fda704 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aeb expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.737876:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:2.0:1788587015.737881:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587015.737946:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+45:2408:x1875469110702848:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 137us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.737954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788587015.738907:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.740024:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110702976 00000100:00100000:0.0:1788587015.740036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110702976 00000100:00100000:1.0:1788587015.740532:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 218 00000100:00100000:1.0:1788587015.741109:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+45:12437:x1875469110702976:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587015.741140:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587015.741164:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810af2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.741303:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda719 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.741328:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.741349:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda719 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587015.741362:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788587015.741512:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af2 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.741533:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af2 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.741542:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:1.0:1788587015.741546:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788587015.741549:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466600, rc 0) 00000100:00100000:1.0:1788587015.742003:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+47:12437:x1875469110702976:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1323us (2963us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788587015.742013:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 218 00000100:00100000:3.0:1788587015.756170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.756270:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703104 00000100:00100000:1.0:1788587015.756289:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703104 00000100:00100000:1.0:1788587015.756359:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:1.0:1788587015.756370:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110703104:12345-192.168.203.1@tcp:1:lfs.0 00010000:00010000:1.0:1788587015.756448:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.756484:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.756493:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587015.756497:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587015.756502:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.756545:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.756569:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 8 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.756584:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1875469127524480:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788587015.756690:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc851180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587015.764917:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1875469127524480:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788587015.764949:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587015.766099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.766761:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703232 00000100:00100000:1.0:1788587015.766771:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703232 00002000:00100000:1.0:1788587015.766821:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f5a84464700 x1875469110703232/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:331/0 lens 504/0 e 0 to 0 dl 1788587026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587015.766930:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a84464700 with x1875469110703232 ext(0->8) 00010000:00010000:1.0:1788587015.766941:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 9 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.767843:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 9 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587015.767861:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5a84464700 00000100:00100000:1.0:1788587015.767909:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:1.0:1788587015.767925:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+9:2408:x1875469110703232:12345-192.168.203.1@tcp:4:lfs.0 00000100:00100000:1.0:1788587015.769897:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+11:2408:x1875469110703232:12345-192.168.203.1@tcp:4:lfs.0 Request processed in 1970us (3794us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788587015.769911:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 3 00002000:00100000:1.0:1788587015.769923:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f5a84464700 x1875469110703232/t4294967309(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:331/0 lens 504/448 e 0 to 0 dl 1788587026 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587015.769934:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a84464700 with x1875469110703232 ext(0->8) 00010000:00010000:1.0:1788587015.769943:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 11 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.769963:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 11 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587015.769971:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f5a84464700 00000001:00080000:3.0:1788587015.771326:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788587015.771350:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788587015.780043:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.783950:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.783989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.784013:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.784044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.784070:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587015.784098:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703616 00000100:00100000:0.0:1788587015.784108:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703616 00000100:00100000:0.0:1788587015.784163:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703872 00000100:00100000:0.0:1788587015.784180:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703872 00000100:00100000:3.0:1788587015.784188:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110704000 00000100:00100000:3.0:1788587015.784196:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110704000 00000100:00100000:0.0:1788587015.784210:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 286 00000100:00100000:0.0:1788587015.784221:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110703616:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587015.784230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 287 00000100:00100000:3.0:1788587015.784251:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2407:x1875469110703872:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587015.784293:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110703616:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.784295:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2407:x1875469110703872:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587015.784307:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 286 00000100:00100000:2.0:1788587015.784366:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703488 00000100:00100000:2.0:1788587015.784370:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703488 00000100:00100000:2.0:1788587015.784402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 382 00000100:00100000:2.0:1788587015.784410:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110703488:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587015.784469:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2406:x1875469110703488:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 59us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587015.784485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 382 00000100:00100000:1.0:1788587015.784669:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703360 00000100:00100000:1.0:1788587015.784680:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703360 00000100:00100000:1.0:1788587015.784693:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110703744 00000100:00100000:1.0:1788587015.784695:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110703744 00000100:00100000:1.0:1788587015.784725:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 125 00000100:00100000:1.0:1788587015.784732:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+9:2406:x1875469110703744:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587015.784760:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+9:2406:x1875469110703744:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.784766:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 125 00010000:00010000:1.0:1788587015.784798:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 7 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.784826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 97 00000100:00100000:1.0:1788587015.784845:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110703360:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587015.784856:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788587015.784873:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788587015.784876:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587015 00002000:00010000:1.0:1788587015.784879:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788587015 00002000:00010000:1.0:1788587015.784881:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788587015 00002000:00010000:1.0:1788587015.784883:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788587015.784890:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 7 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.784904:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 7 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.784927:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fda6e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810add expref: 7 pid: 8436 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.784959:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 287 00010000:00010000:1.0:1788587015.784959:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587015.784964:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587015.784973:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.784985:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.784989:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 288 00000100:00100000:3.0:1788587015.785001:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110704000:12345-192.168.203.1@tcp:400:kworker.0 00010000:00010000:1.0:1788587015.785019:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587015.785035:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2406:x1875469110704000:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587015.785037:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.785047:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 288 00010000:00010000:1.0:1788587015.785054:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785075:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785084:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785092:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785099:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587015.785110:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785120:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785132:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.785140:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009647c3ae/0xfbc93bbea5fda727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.785183:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+6:2409:x1875469110703104:12345-192.168.203.1@tcp:1:lfs.0 Request processed in 28814us (29021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.785190:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:1.0:1788587015.785218:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110703360:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 387us (5187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.785224:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 97 00000100:00080000:1.0:1788587015.785255:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587015.785260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587015.790887:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.791035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110704256 00000100:00100000:2.0:1788587015.791046:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110704256 00000100:00100000:2.0:1788587015.791103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:2.0:1788587015.791113:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+47:12437:x1875469110704256:12345-192.168.203.1@tcp:35:lfs.0 00000004:00010000:2.0:1788587015.791184:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda719 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af2 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587015.791377:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788587015.791411:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788587015.791715:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788587015.791753:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.791768:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.791778:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.791812:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.791827:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 51 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587015.792019:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875469127524608:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587015.792122:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587015.795745:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1875469127524608:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587015.795777:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587015.800677:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.800762:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110704384 00000100:00100000:3.0:1788587015.800772:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110704384 00010000:00010000:3.0:1788587015.800810:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 52 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.800956:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 98 00000100:00100000:3.0:1788587015.800967:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+52:2407:x1875469110704384:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587015.800982:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587015.800989:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 52 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.801003:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 52 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.801027:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda6d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810acf expref: 52 pid: 6520 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.801045:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:3.0:1788587015.801049:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.801058:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.802982:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.803146:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587015.803248:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+51:2407:x1875469110704384:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 2264us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.803258:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 98 00010000:00010000:0.0:1788587015.808408:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587015.808703:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587015.808826:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788587015.808955:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788587015.809056:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84467480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127524736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788587015.809120:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587015.809675:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127524736 00000100:00100000:1.0:1788587015.809685:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127524736 00000100:00100000:0.0:1788587015.809786:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b84f3dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587015.809956:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788587015.809966:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127524736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587015.810077:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127524736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 112us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.810084:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788587015.810257:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1788587015.810264:0:6523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1788587015.810294:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a84521880, transno 4294967308 00000100:00100000:3.0:1788587015.810323:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84467480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127524736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788587015.810487:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788587015.810550:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84526680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127524864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587015.810593:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587015.810613:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e85d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587015.813191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127524864 00000100:00100000:0.0:1788587015.813205:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127524864 00000100:00100000:0.0:1788587015.813265:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788587015.813276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1875469127524864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788587015.813751:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1875469127524864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 476us (3156us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788587015.813759:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788587015.815089:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587015.819055:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84526680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1875469127524864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788587015.819632:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788587015.819696:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.819709:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.819718:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.819725:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587015.819744:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.819752:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.819766:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:3.0:1788587015.819769:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788587015.819774:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.819780:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda72e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587015.819894:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788587015.819955:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788587015.819967:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361750550040ns, next at 362750547635ns, rc = 0 00000001:00080000:3.0:1788587015.819972:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788587015.819996:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5a83482000) 00010000:00010000:3.0:1788587015.819999:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788587015.820008:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda719 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af2 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587015.820181:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+54:12437:x1875469110704256:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 29068us (29303us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788587015.820190:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 56 00000020:00080000:3.0:1788587015.820196:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788587015.842471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587015.842672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110704512 00000100:00100000:3.0:1788587015.842681:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110704512 00000100:00100000:3.0:1788587015.842741:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 219 00000100:00100000:3.0:1788587015.842752:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+54:12437:x1875469110704512:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587015.842789:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587015.842810:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda735 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810af9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.842864:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda735 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af9 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.842879:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda735 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af9 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587015.842898:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:3.0:1788587015.842901:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587015.842905:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1bc00, rc 0) 00000100:00100000:3.0:1788587015.842963:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+55:12437:x1875469110704512:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 212us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587015.842970:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 219 00000100:00100000:0.0:1788587015.848848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.848946:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110704768 00000100:00100000:1.0:1788587015.848956:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110704768 00000100:00100000:1.0:1788587015.849012:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:1.0:1788587015.849022:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+55:12437:x1875469110704768:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788587015.849267:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+56:12437:x1875469110704768:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 245us (428us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788587015.849275:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:0.0:1788587015.925191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.925298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110704896 00000100:00100000:1.0:1788587015.925319:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110704896 00000100:00100000:1.0:1788587015.925390:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 220 00000100:00100000:1.0:1788587015.925401:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+56:12447:x1875469110704896:12345-192.168.203.1@tcp:34:lfs.0 00010000:00010000:1.0:1788587015.925515:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925533:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925543:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925555:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925568:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925642:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925665:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925672:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587015.925722:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925735:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925741:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925748:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925754:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.925757:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925765:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925776:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587015.925779:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.925783:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925790:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda73c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925811:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925817:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925823:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925829:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.925832:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925838:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925846:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:1.0:1788587015.925849:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.925852:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925858:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda743 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925867:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925872:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925878:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925889:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.925892:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925898:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925906:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587015.925909:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587015.925912:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.925918:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda74a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.925981:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+56:12447:x1875469110704896:12345-192.168.203.1@tcp:34:lfs.0 Request processed in 581us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.925989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 220 00000100:00100000:0.0:1788587015.965136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587015.965231:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110705152 00000100:00100000:2.0:1788587015.965252:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110705152 00000100:00100000:2.0:1788587015.965355:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 221 00000100:00100000:2.0:1788587015.965377:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+56:12450:x1875469110705152:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587015.965400:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587015.965458:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda751 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b00 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965533:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965562:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965575:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965587:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965595:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965603:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965727:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965736:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965744:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587015.965754:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788587015.965823:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965831:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965838:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965845:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587015.965850:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965858:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965870:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587015.965873:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587015.965879:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965895:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda758 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965910:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965916:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965921:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965927:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587015.965930:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965936:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965943:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:2.0:1788587015.965945:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587015.965948:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965953:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda75f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.965987:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda751 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 59 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.966012:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 58 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587015.966021:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587015.966023:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587015.966025:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71c00, rc 0) 00000100:00100000:2.0:1788587015.966092:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+58:12450:x1875469110705152:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 727us (965us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788587015.966099:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 221 00000100:00100000:0.0:1788587015.972775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.972857:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110705280 00000100:00100000:1.0:1788587015.972867:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110705280 00000100:00100000:1.0:1788587015.972926:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 222 00000100:00100000:1.0:1788587015.972937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+58:12450:x1875469110705280:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788587015.973020:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973039:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973052:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973101:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973109:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973115:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973121:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587015.973126:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973144:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973157:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587015.973160:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587015.973165:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587015.973172:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda774 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587015.973248:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+58:12450:x1875469110705280:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 312us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587015.973255:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 222 00000100:00100000:0.0:1788587015.984836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587015.993589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110705536 00000100:00100000:1.0:1788587015.993607:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110705536 00000100:00100000:1.0:1788587015.993685:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:1.0:1788587015.993711:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+58:12450:x1875469110705536:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:1.0:1788587015.993949:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+59:12450:x1875469110705536:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 240us (9122us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788587015.993958:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:0.0:1788587016.065951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.067691:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110705792 00000100:00100000:2.0:1788587016.067706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110705792 00000100:00100000:2.0:1788587016.067955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 223 00000100:00100000:2.0:1788587016.067969:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+59:12460:x1875469110705792:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587016.067993:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.067996:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587016.068021:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda6f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ae4 expref: 59 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.068042:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587016.068048:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587016.068061:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda77b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b07 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.068173:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.068206:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 59 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.068213:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.068257:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 59 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.068270:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 59 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.068284:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127524992:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587016.069802:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587016.073989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.074343:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110705920 00000100:00100000:1.0:1788587016.074353:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110705920 00010000:00010000:1.0:1788587016.074393:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 60 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.074461:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 99 00000100:00100000:1.0:1788587016.074471:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+60:2408:x1875469110705920:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587016.074486:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587016.074492:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 60 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.074506:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 60 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.074530:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.074535:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.074543:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.074551:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.074584:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587016.074646:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+60:2408:x1875469110705920:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 175us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.074653:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 99 00010000:00010000:2.0:1788587016.075525:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b00 expref: 59 pid: 10048 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.075546:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127524992:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587016.075695:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.075706:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.075712:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587016.075732:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788587016.075978:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda77b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.075990:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.075996:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587016.075998:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587016.076000:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70a00, rc 0) 00000100:00100000:2.0:1788587016.076044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+59:12460:x1875469110705792:12345-192.168.203.1@tcp:101:bash.0 Request processed in 8079us (10104us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788587016.076051:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 223 00000100:00100000:0.0:1788587016.078351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.078578:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110706048 00000100:00100000:2.0:1788587016.078587:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110706048 00000100:00100000:2.0:1788587016.078643:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 224 00000100:00100000:2.0:1788587016.078654:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+59:12460:x1875469110706048:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587016.078681:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.078700:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda790 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b0e expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.078733:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.078748:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.078760:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.078998:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 61 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.079017:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 60 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.079025:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587016.079028:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587016.079032:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71800, rc 0) 00000100:00100000:2.0:1788587016.079136:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+60:12460:x1875469110706048:12345-192.168.203.1@tcp:101:bash.0 Request processed in 484us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.079143:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 224 00000100:00100000:0.0:1788587016.081328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.082958:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110706304 00000100:00100000:1.0:1788587016.082972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110706304 00000100:00100000:1.0:1788587016.083090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 225 00000100:00100000:1.0:1788587016.083101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+60:12460:x1875469110706304:12345-192.168.203.1@tcp:36:bash.0 00010000:00010000:1.0:1788587016.083334:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.083351:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.083362:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587016.083406:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788587016.083457:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dca5e60 reply state 0000000048b56412 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.083470:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.083478:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.083481:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587016.083485:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587016.083577:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+63:12460:x1875469110706304:12345-192.168.203.1@tcp:36:bash.0 Request processed in 476us (2266us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788587016.083601:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 225 00000020:00080000:1.0:1788587016.083606:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788587016.086216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.086250:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110706432 00000100:00100000:2.0:1788587016.086260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110706432 00000100:00100000:2.0:1788587016.086329:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 226 00000100:00100000:2.0:1788587016.086340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+63:12460:x1875469110706432:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587016.086362:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.086381:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda7a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.086491:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.086503:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.086510:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.086546:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.086555:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 64 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.086569:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127525120:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587016.086656:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587016.089296:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127525120:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587016.089357:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587016.089748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.089823:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110706560 00000100:00100000:2.0:1788587016.089830:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110706560 00010000:00010000:2.0:1788587016.089866:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 65 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.089905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 100 00000100:00100000:2.0:1788587016.089915:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+65:2409:x1875469110706560:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.089929:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.089936:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 65 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.089948:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 65 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.089971:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda782 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b07 expref: 65 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.089988:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587016.090005:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.090015:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.090023:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.090056:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587016.090113:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+64:2409:x1875469110706560:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 198us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.090120:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 100 00010000:00010000:0.0:1788587016.090224:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.090231:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587016.090288:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788587016.090292:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587016.090322:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.090352:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fda7a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.090367:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.090375:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:0.0:1788587016.090385:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587016.090388:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71400, rc 0) 00000100:00100000:0.0:1788587016.090440:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+63:12460:x1875469110706432:12345-192.168.203.1@tcp:101:bash.0 Request processed in 4077us (4206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.090448:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 226 00000100:00100000:2.0:1788587016.093948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.094061:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110706816 00000100:00100000:1.0:1788587016.094070:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110706816 00000100:00100000:1.0:1788587016.094128:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:1.0:1788587016.094139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+63:12460:x1875469110706816:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:1.0:1788587016.094721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+64:12460:x1875469110706816:12345-192.168.203.1@tcp:35:bash.0 Request processed in 581us (784us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788587016.094729:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:1.0:1788587016.145556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.145689:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110706944 00000100:00100000:2.0:1788587016.145700:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110706944 00000100:00100000:2.0:1788587016.145761:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 227 00000100:00100000:2.0:1788587016.145772:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+64:12466:x1875469110706944:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587016.145796:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.145817:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda7b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b1c expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.145881:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda7ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.145896:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.145908:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587016.145966:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788587016.145970:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587016.145989:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda7ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.146025:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70a00/0xfbc93bbea5fda7b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b1c expref: 66 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.146045:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda7ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b1c expref: 65 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.146053:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587016.146056:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587016.146060:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70600, rc 0) 00000100:00100000:2.0:1788587016.146125:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+65:12466:x1875469110706944:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 354us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.146132:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 227 00000100:00100000:3.0:1788587016.150952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.151092:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110707072 00000100:00100000:1.0:1788587016.151103:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110707072 00000100:00100000:1.0:1788587016.151160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 228 00000100:00100000:1.0:1788587016.151170:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+65:12466:x1875469110707072:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587016.151190:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587016.151210:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151282:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151320:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151332:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151354:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151361:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151467:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151477:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151483:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587016.151523:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587016.151527:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587016.151545:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151557:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151565:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151571:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151577:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151593:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.151598:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151605:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151616:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587016.151619:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587016.151624:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151630:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda7c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151642:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151648:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151654:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151659:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.151661:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151667:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151686:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:1.0:1788587016.151688:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587016.151691:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151697:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda7cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151723:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151737:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.151744:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.151746:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587016.151748:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466800, rc 0) 00000100:00100000:1.0:1788587016.151807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+66:12466:x1875469110707072:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 637us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.151815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 228 00000100:00100000:0.0:1788587016.156260:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.156406:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110707328 00000100:00100000:2.0:1788587016.156456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110707328 00000100:00100000:2.0:1788587016.156506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 229 00000100:00100000:2.0:1788587016.156516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+66:12466:x1875469110707328:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587016.156536:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.156556:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda7dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b2a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156679:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156705:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156714:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156723:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156756:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156773:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.156787:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127525248:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587016.156882:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.156891:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 67 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.156900:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e82680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127525376:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587016.156924:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa780c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788587016.159654:0:6520:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.1@tcp) returned -22 from blocking AST (req@0000000083ac0db7 x1875469127525248) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.159678:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.159701:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda7d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b23 expref: 67 pid: 6522 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.159715:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127525248:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587016.159730:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e82680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127525376:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587016.159756:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:0.0:1788587016.159761:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.159770:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.159780:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.161148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.161269:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.161558:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110707456 00000100:00100000:2.0:1788587016.161567:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110707456 00000100:00100000:2.0:1788587016.161634:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110707584 00000100:00100000:2.0:1788587016.161638:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110707584 00010000:00010000:2.0:1788587016.161655:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 68 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.161683:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 101 00000100:00100000:2.0:1788587016.161692:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+68:2408:x1875469110707584:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.161706:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.161713:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 68 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161725:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 68 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161746:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda7ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b15 expref: 68 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161762:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587016.161767:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161777:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161785:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161812:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587016.161857:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:2408:x1875469110707584:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 165us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.161873:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 101 00000100:00100000:2.0:1788587016.161891:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:2.0:1788587016.161898:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+66:2408:x1875469110707456:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.161906:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.161909:0:6507:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fbc93bbea5fda7d6) 00010000:00010000:2.0:1788587016.161910:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587016.161928:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+66:2408:x1875469110707456:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 31us (787us total) trans 0 rc 116/116 00000100:00100000:2.0:1788587016.161935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00010000:00010000:2.0:1788587016.161984:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.161992:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587016.162008:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788587016.162135:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71200/0xfbc93bbea5fda7dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.162152:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.162160:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587016.162163:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587016.162166:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71c00, rc 0) 00000100:00100000:2.0:1788587016.162195:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+66:12466:x1875469110707328:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 5680us (5944us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788587016.162210:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 229 00000100:00100000:2.0:1788587016.165052:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.165149:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110707840 00000100:00100000:0.0:1788587016.165159:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110707840 00000100:00100000:0.0:1788587016.165222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:0.0:1788587016.165240:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+66:12466:x1875469110707840:12345-192.168.203.1@tcp:103:lfs.0 00010000:00010000:0.0:1788587016.165255:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587016.165277:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1bc00/0xfbc93bbea5fda735 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810af9 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.165295:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:0.0:1788587016.165300:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587016.165364:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+65:12466:x1875469110707840:12345-192.168.203.1@tcp:103:lfs.0 Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.165372:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:3.0:1788587016.168518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.168683:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110707968 00000100:00100000:1.0:1788587016.168693:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110707968 00000100:00100000:1.0:1788587016.168751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 230 00000100:00100000:1.0:1788587016.168761:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+65:12466:x1875469110707968:12345-192.168.203.1@tcp:58:lfs.0 00010000:00010000:1.0:1788587016.168858:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.168876:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.168901:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587016.169005:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788587016.169088:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+65:12466:x1875469110707968:12345-192.168.203.1@tcp:58:lfs.0 Request processed in 327us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.169096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 230 00000100:00100000:3.0:1788587016.170949:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.171316:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110708096 00000100:00100000:0.0:1788587016.171325:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110708096 00000100:00100000:0.0:1788587016.171387:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 231 00000100:00100000:0.0:1788587016.171398:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+65:12466:x1875469110708096:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788587016.171525:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587016.171545:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b31 expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.171625:0:13553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.171634:0:13553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 66 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.171663:0:13553:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.171673:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 66 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.171683:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:0.0:1788587016.171684:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587016.171687:0:13553:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 66 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.171693:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788587016.171891:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+66:12466:x1875469110708096:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 435us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.171900:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 231 00000040:00080000:3.0:1788587016.340652:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587016.340661:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587016.340745:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788587016.340753:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587016.340874:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84527800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127525504:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587016.343605:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e85180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587016.349602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.349754:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84527800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127525504:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587016.349900:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110708224 00000100:00100000:0.0:1788587016.349908:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110708224 00000100:00100000:0.0:1788587016.349965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 232 00000100:00100000:0.0:1788587016.349975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+66:12467:x1875469110708224:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587016.350007:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587016.350115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+66:12467:x1875469110708224:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 141us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.350124:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 232 00000100:00100000:2.0:1788587016.357509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.357750:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110708352 00000100:00100000:1.0:1788587016.357759:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110708352 00000100:00100000:1.0:1788587016.357804:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 233 00000100:00100000:1.0:1788587016.357813:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+66:12467:x1875469110708352:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788587016.357877:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.357894:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.357906:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361067:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361090:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361102:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361134:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361158:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361165:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587016.361218:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587016.361222:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587016.361238:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361249:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361255:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361261:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361267:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.361271:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361278:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361290:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:1.0:1788587016.361294:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587016.361298:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361327:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda800 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361346:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361351:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361356:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.361360:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.361363:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362087:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362099:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8f5a83482900) 00010000:00010000:1.0:1788587016.362102:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587016.362106:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362111:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda807 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362132:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362138:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362153:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362158:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.362160:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362167:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362175:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.362178:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587016.362181:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.362187:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda80e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.362279:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+66:12467:x1875469110708352:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 Request processed in 4463us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.362290:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 233 00000100:00100000:3.0:1788587016.367011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.367074:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110708608 00000100:00100000:2.0:1788587016.367085:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110708608 00000100:00100000:2.0:1788587016.367155:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 234 00000100:00100000:2.0:1788587016.367166:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+66:12467:x1875469110708608:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587016.367185:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.367206:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda815 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b38 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.367319:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.367336:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.367348:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587016.367360:0:10048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788587016.367581:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.367590:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.367597:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368077:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587016.368082:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368091:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368106:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587016.368109:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587016.368227:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368235:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda81c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368283:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda815 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b38 expref: 68 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368292:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:2.0:1788587016.368295:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587016.368299:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71400/0xfbc93bbea5fda815 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b38 expref: 68 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.368319:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71400, rc 0) 00000100:00100000:2.0:1788587016.368390:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+67:12467:x1875469110708608:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 1226us (1390us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788587016.368406:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 234 00000100:00100000:2.0:1788587016.373650:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.373728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110708736 00000100:00100000:1.0:1788587016.373739:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110708736 00000100:00100000:1.0:1788587016.373864:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 235 00000100:00100000:1.0:1788587016.373875:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:12467:x1875469110708736:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587016.373909:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587016.374069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:12467:x1875469110708736:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 194us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.374087:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 235 00000100:00100000:3.0:1788587016.383346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.383466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110708992 00000100:00100000:1.0:1788587016.383477:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110708992 00000100:00100000:1.0:1788587016.383531:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 236 00000100:00100000:1.0:1788587016.383541:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+67:12467:x1875469110708992:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587016.383562:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587016.383565:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587016.383592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70600/0xfbc93bbea5fda7ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b1c expref: 67 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.383625:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587016.383631:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587016.383645:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda82a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587016.384355:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788587016.384546:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda831 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.384561:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.384573:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.384897:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda82a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b3f expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.384949:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda831 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b3f expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.384957:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482900) 00010000:00010000:1.0:1788587016.384960:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587016.384962:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467e00, rc 0) 00000100:00100000:1.0:1788587016.385032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+68:12467:x1875469110708992:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 1491us (1696us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788587016.385040:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 236 00000100:00100000:3.0:1788587016.390576:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.390798:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110709248 00000100:00100000:2.0:1788587016.390808:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110709248 00000100:00100000:2.0:1788587016.390865:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 237 00000100:00100000:2.0:1788587016.390875:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+68:12467:x1875469110709248:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587016.390939:0:10048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.390965:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467e00/0xfbc93bbea5fda831 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b3f expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.390984:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482900) 00010000:00010000:2.0:1788587016.390995:0:10048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587016.391014:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391027:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391037:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391052:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391058:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391065:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391107:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391132:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391139:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391144:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587016.391149:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391157:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391167:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:2.0:1788587016.391169:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587016.391173:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391179:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda83f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391190:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391196:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391202:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391207:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587016.391215:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391222:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391230:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x92271766 (ffff8f5b83c9cc00) 00010000:00010000:2.0:1788587016.391233:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587016.391236:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.391242:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda846 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x92271766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.391332:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+67:12467:x1875469110709248:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 457us (763us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587016.391339:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 237 00000100:00100000:2.0:1788587016.395284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.395370:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110709376 00000100:00100000:1.0:1788587016.395380:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110709376 00000100:00100000:1.0:1788587016.395469:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 238 00000100:00100000:1.0:1788587016.395480:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+67:12467:x1875469110709376:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587016.395498:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587016.395520:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda84d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b46 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.395552:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.395565:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.395575:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.395701:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467600/0xfbc93bbea5fda84d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.395728:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.395737:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:1.0:1788587016.395739:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587016.395742:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466200, rc 0) 00000100:00100000:1.0:1788587016.395802:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+68:12467:x1875469110709376:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 324us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.395808:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 238 00000100:00100000:1.0:1788587016.400646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.400734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110709632 00000100:00100000:2.0:1788587016.400743:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110709632 00000100:00100000:2.0:1788587016.400794:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 239 00000100:00100000:2.0:1788587016.400804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+68:12467:x1875469110709632:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587016.400885:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.400904:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.400916:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587016.401103:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1788587016.401151:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c43c411e reply state 0000000023231ed7 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.401164:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.401173:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:2.0:1788587016.401176:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788587016.401180:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587016.401274:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+70:12467:x1875469110709632:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 471us (636us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788587016.401282:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 239 00000100:00100000:3.0:1788587016.406593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.406768:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110709760 00000100:00100000:0.0:1788587016.406778:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110709760 00000100:00100000:0.0:1788587016.406838:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 240 00000100:00100000:0.0:1788587016.406864:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+70:12467:x1875469110709760:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587016.406889:0:13553:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587016.406911:0:13553:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b4d expref: -99 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.406981:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 71 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.406996:0:13553:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 71 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.407014:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:0.0:1788587016.407017:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587016.407021:0:13553:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788587016.407082:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+71:12467:x1875469110709760:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 221us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.407091:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 240 00000100:00100000:3.0:1788587016.409641:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.409735:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110709888 00000100:00100000:2.0:1788587016.409744:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110709888 00000100:00100000:2.0:1788587016.409813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00100000:2.0:1788587016.409823:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2409:x1875469110709888:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587016.410045:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110709888:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 222us (412us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788587016.410053:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 70 00000100:00100000:3.0:1788587016.413155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.413360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110710144 00000100:00100000:0.0:1788587016.413370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110710144 00000100:00100000:0.0:1788587016.413535:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:0.0:1788587016.413545:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+71:12467:x1875469110710144:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587016.413987:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+72:12467:x1875469110710144:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 441us (838us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788587016.413995:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:3.0:1788587016.417002:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.417157:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110710400 00000100:00100000:0.0:1788587016.417166:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110710400 00000100:00100000:0.0:1788587016.417232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 241 00000100:00100000:0.0:1788587016.417242:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+72:12467:x1875469110710400:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587016.417368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+72:12467:x1875469110710400:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 126us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.417393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 241 00000100:00100000:3.0:1788587016.420505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.420872:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110710528 00000100:00100000:0.0:1788587016.420882:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110710528 00000100:00100000:0.0:1788587016.420952:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 242 00000100:00100000:0.0:1788587016.420963:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+72:12467:x1875469110710528:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587016.420982:0:10048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587016.421011:0:10048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda869 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b54 expref: -99 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.421080:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.421096:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.421108:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587016.421153:0:10048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587016.421173:0:10048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.421199:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda869 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b54 expref: 74 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.421218:0:10048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b54 expref: 73 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.421237:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:0.0:1788587016.421254:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587016.421258:0:10048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4a00, rc 0) 00000100:00100000:0.0:1788587016.421323:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a835db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+73:12467:x1875469110710528:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 362us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.421330:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 242 00000100:00100000:3.0:1788587016.424769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.424944:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110710656 00000100:00100000:1.0:1788587016.424955:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110710656 00000100:00100000:1.0:1788587016.425015:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 71 00000100:00100000:1.0:1788587016.425026:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+10:2409:x1875469110710656:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587016.425043:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587016.425063:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b5b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587016.425088:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac08, blocks: 0x0 00010000:00010000:1.0:1788587016.425106:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1788587016.425111:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587016.425121:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.425141:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.425169:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467600, rc 0) 00000100:00100000:1.0:1788587016.425234:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+11:2409:x1875469110710656:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 203us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.425241:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 71 00000100:00100000:3.0:1788587016.428830:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.429042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110710912 00000100:00100000:1.0:1788587016.429051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110710912 00000100:00100000:1.0:1788587016.429109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 243 00000100:00100000:1.0:1788587016.429120:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+73:12467:x1875469110710912:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587016.429752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+73:12467:x1875469110710912:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 632us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.429760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 243 00000100:00100000:3.0:1788587016.432035:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.432338:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711040 00000100:00100000:2.0:1788587016.432348:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711040 00000100:00100000:2.0:1788587016.432405:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:2.0:1788587016.432446:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+11:12467:x1875469110711040:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587016.432478:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587016.432497:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b62 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.432527:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.432537:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587016.432540:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587016.432545:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.432578:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.432591:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.432603:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127525632:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587016.433224:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587016.435561:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1875469127525632:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587016.435597:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.435630:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70400, rc 0) 00000100:00100000:2.0:1788587016.435695:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+12:12467:x1875469110711040:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 3280us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.435703:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 72 00000100:00100000:3.0:1788587016.437261:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.438162:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711168 00000100:00100000:2.0:1788587016.438173:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711168 00010000:00010000:2.0:1788587016.439090:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.439177:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:2.0:1788587016.439191:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+12:2408:x1875469110711168:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.439206:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.439239:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.439252:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.439278:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000188e6240/0xfbc93bbea5fda877 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b5b expref: 12 pid: 8434 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.439295:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587016.439299:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587016.439316:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.439326:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.439381:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.439396:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1875469127525760:192.168.203.1@tcp:105: 00000100:00100000:2.0:1788587016.439526:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587016.442148:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1875469127525760:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788587016.442175:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587016.442404:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:207b4310-f56a-4e63-b878-60fda37c3e93+11:2408:x1875469110711168:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 3216us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.442450:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:3.0:1788587016.442665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.442796:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711296 00000100:00100000:2.0:1788587016.442803:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711296 00002000:00100000:2.0:1788587016.442842:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8f5a845ec380 x1875469110711296/t0(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:332/0 lens 504/0 e 0 to 0 dl 1788587027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587016.442852:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a845ec380 with x1875469110711296 ext(0->12) 00002000:00010000:2.0:1788587016.442858:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a845ec380 00000100:00100000:2.0:1788587016.442897:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:2.0:1788587016.442906:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+11:2409:x1875469110711296:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587016.444508:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:207b4310-f56a-4e63-b878-60fda37c3e93+13:2409:x1875469110711296:12345-192.168.203.1@tcp:4:lhsmtool_posix.0 Request processed in 1595us (1835us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788587016.444520:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 6 00002000:00100000:2.0:1788587016.444530:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8f5a845ec380 x1875469110711296/t4294967321(0) o4->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:332/0 lens 504/448 e 0 to 0 dl 1788587027 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587016.444556:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a845ec380 with x1875469110711296 ext(0->12) 00002000:00010000:2.0:1788587016.444561:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a845ec380 00000100:00100000:0.0:1788587016.448727:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.448810:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711424 00000100:00100000:2.0:1788587016.448821:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711424 00000100:00100000:2.0:1788587016.448881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 244 00000100:00100000:2.0:1788587016.448892:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+73:12467:x1875469110711424:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788587016.451822:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1788587016.451858:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788587016.451958:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.451970:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.451978:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.451983:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.451988:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.451994:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452010:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f5b85f9f500) 00010000:00010000:0.0:1788587016.452013:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.452018:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452024:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70200/0xfbc93bbea5fda583 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.452032:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788587016.452049:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.452053:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127525888:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788587016.452067:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452073:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452079:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.452082:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452087:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452095:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f5b85f9fb00) 00010000:00010000:0.0:1788587016.452097:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.452100:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452107:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1b600/0xfbc93bbea5fda62b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452121:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452127:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.452131:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587016.452133:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452138:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.452145:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452151:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452158:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:0.0:1788587016.452160:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.452163:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452169:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a600/0xfbc93bbea5fda6a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.452174:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127525888 00010000:00010000:0.0:1788587016.452178:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.452180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127525888 00010000:00010000:0.0:1788587016.452184:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452189:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452193:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.452196:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452201:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452208:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b85f9f200) 00010000:00010000:0.0:1788587016.452210:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.452217:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452224:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda6cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.452227:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587016.452234:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127525888:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788587016.452239:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452245:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452250:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452255:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466c00 already unused, calling callback (ffffffffc19ef4f0) 00002000:00080000:1.0:1788587016.452257:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788587016.452258:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452263:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452271:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:0.0:1788587016.452273:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.452275:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452280:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466c00/0xfbc93bbea5fda79e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587016.452283:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bac07, atime: 0x6a9bac07, ctime: 0x6a9bac07, blocks: 0x8 00010000:00010000:1.0:1788587016.452290:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452290:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452297:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.452318:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1788587016.452320:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452325:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.452327:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587016.452328:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.452334:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452334:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452343:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:0.0:1788587016.452345:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587016.452348:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.452350:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.452354:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fda85b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.452358:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.452365:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.452378:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587016.452444:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587016.452451:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.452458:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587016.452462:0:10387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.452468:0:10387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.452481:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.452498:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000428ed7a9/0xfbc93bbea5fda885 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.452512:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587016.452514:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587016.452516:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587016.452530:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875469127525888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 296us (398us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788587016.452537:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1788587016.452837:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a83f89880/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788587016.452844:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127525888:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788587016.453175:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5bb4e85600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788587016.453180:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83d51000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5bb4e85840 00000020:00080000:2.0:1788587016.453184:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83d51400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5baf1c5e00 00000004:00080000:2.0:1788587016.453213:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788587016.453282:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788587016.453347:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587016.453359:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127526016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788587016.453400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587016.453448:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127526016 00000100:00100000:1.0:1788587016.453453:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127526016 00000100:00100000:1.0:1788587016.453486:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587016.453493:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127526016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788587016.453508:0:10047:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788587016.453525:0:10047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.453554:0:10047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 12 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.453562:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788587016.453566:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587016.453570:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.453594:0:10047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 12 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.453609:0:10047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 12 pid: 10047 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.453632:0:10047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10047:1875469127526144:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788587016.453687:0:10047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6d00c0 going to sleep for 11 seconds 00000020:00080000:2.0:1788587016.454517:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5b916dd480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788587016.454522:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83545a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5b916dd000 00000020:00080000:2.0:1788587016.454526:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83545600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5a83121200 00000020:00080000:2.0:1788587016.454550:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788587016.454562:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788587016.454622:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788587016.454662:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+21:12467:x1875469110711424:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 Request processed in 5770us (5943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.454670:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 244 00000100:00100000:1.0:1788587016.457599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.460127:0:10047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10047:1875469127526144:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788587016.460158:0:10047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587016.460595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.461142:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711552 00000100:00100000:0.0:1788587016.461152:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711552 00000100:00100000:2.0:1788587016.461244:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711680 00000100:00100000:2.0:1788587016.461249:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711680 00010000:00010000:2.0:1788587016.461287:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 14 pid: 10047 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.461493:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:2.0:1788587016.461504:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+14:2409:x1875469110711680:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.461521:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.461528:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 14 pid: 10047 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.461542:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 14 pid: 10047 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.461564:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b56d0ab/0xfbc93bbea5fda639 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810aba expref: 14 pid: 10047 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.461579:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587016.461583:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587016.461589:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.461599:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.461630:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587016.461678:0:10047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.461688:0:10047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.461704:0:10047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.461712:0:10047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.461735:0:10047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587016.461907:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875469127526016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8413us (8505us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788587016.461915:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788587016.461975:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a83f88000/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788587016.461987:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127526016:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788587016.462168:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587016.462176:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.462184:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587016.462188:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.462198:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.462212:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.462219:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2440f24/0xfbc93bbea5fda88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.462249:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587016.462258:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587016.462259:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587016.462570:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 75 00000100:00100000:1.0:1788587016.462580:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+13:2408:x1875469110711552:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788587016.463511:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+13:2409:x1875469110711680:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 2005us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.463521:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 103 00000001:00080000:0.0:1788587016.465534:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1788587016.465549:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1788587016.466285:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110711552:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 Request processed in 3701us (8688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.466297:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 75 00000100:00100000:3.0:1788587016.469142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.469254:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110711936 00000100:00100000:2.0:1788587016.469265:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110711936 00000100:00100000:2.0:1788587016.469332:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 245 00000100:00100000:2.0:1788587016.469342:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+21:12467:x1875469110711936:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587016.469396:0:13553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.469443:0:13553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b54 expref: 21 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.469466:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:2.0:1788587016.469471:0:13553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587016.469503:0:13553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.469516:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.469525:0:13553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587016.469645:0:13553:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcbab82a reply state 000000008cceec8d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.469657:0:13553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.469662:0:13553:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:2.0:1788587016.469665:0:13553:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587016.469667:0:13553:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587016.469767:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+22:12467:x1875469110711936:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 426us (635us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788587016.469791:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 245 00000100:00100000:3.0:1788587016.471824:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.472177:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110712064 00000100:00100000:2.0:1788587016.472187:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110712064 00000100:00100000:2.0:1788587016.472242:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 76 00000100:00100000:2.0:1788587016.472252:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+7:2407:x1875469110712064:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587016.472408:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788587016.472412:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788587016 00002000:00010000:2.0:1788587016.472433:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788587015 00002000:00010000:2.0:1788587016.472436:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788587016 -> 1788587016 00002000:00010000:2.0:1788587016.472438:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788587016.472498:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2407:x1875469110712064:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 247us (681us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788587016.472505:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 76 00000100:00100000:3.0:1788587016.475400:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.475654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110712320 00000100:00100000:0.0:1788587016.475665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110712320 00000100:00100000:0.0:1788587016.475721:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 246 00000100:00100000:0.0:1788587016.475732:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:12467:x1875469110712320:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587016.475802:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.475820:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.475830:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.475880:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.475895:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 22 pid: 6521 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.475909:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127526272:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587016.476002:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587016.483585:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.483800:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127526272:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587016.483830:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.483936:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110712448 00000100:00100000:1.0:1788587016.483943:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110712448 00010000:00010000:1.0:1788587016.483987:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 23 pid: 6521 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.484025:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 104 00000100:00100000:1.0:1788587016.484034:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+23:2408:x1875469110712448:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587016.484049:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587016.484055:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 23 pid: 6521 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.484072:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 23 pid: 6521 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.484093:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466200/0xfbc93bbea5fda854 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b46 expref: 23 pid: 6521 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.484108:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:1.0:1788587016.484112:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.484122:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.484129:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.484170:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587016.484228:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+22:2408:x1875469110712448:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 193us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.484235:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 104 00010000:00010000:0.0:1788587016.484400:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484408:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484479:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484487:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484493:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484498:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.484502:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484517:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484527:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:0.0:1788587016.484531:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788587016.484534:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.484541:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5200/0xfbc93bbea5fda89a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.484595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+21:12467:x1875469110712320:12345-192.168.203.1@tcp:55:lhsmtool_posix.0 Request processed in 8864us (9204us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788587016.484603:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 246 00000100:00100000:3.0:1788587016.500219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.500340:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110712576 00000100:00100000:0.0:1788587016.500351:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110712576 00000100:00100000:0.0:1788587016.500461:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:0.0:1788587016.500473:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2407:x1875469110712576:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788587016.500516:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.500537:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.500547:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587016.500552:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587016.500557:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.500610:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.500639:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 8 pid: 8433 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.500656:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1875469127526400:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587016.500735:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587016.504472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.504746:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1875469127526400:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587016.504772:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.505945:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110712704 00000100:00100000:2.0:1788587016.506026:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110712704 00010000:00010000:2.0:1788587016.506070:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 9 pid: 8433 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.506121:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 105 00000100:00100000:2.0:1788587016.506133:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+9:2408:x1875469110712704:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.506148:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.506172:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 9 pid: 8433 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.506185:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 9 pid: 8433 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.506222:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df1b564/0xfbc93bbea5fda87e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b62 expref: 9 pid: 8433 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.506241:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587016.506245:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587016.506251:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.506261:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.506294:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587016.506358:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110712704:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 227us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.506365:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 105 00010000:00010000:1.0:1788587016.506864:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.506875:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.506895:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.506903:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.506911:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.506917:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587016.506922:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.506931:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.507065:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.507073:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c3666ef/0xfbc93bbea5fda8a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.507140:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2407:x1875469110712576:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 Request processed in 6670us (6930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.507149:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 77 00000100:00100000:3.0:1788587016.509683:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.510019:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110712960 00000100:00100000:2.0:1788587016.510029:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110712960 00000100:00100000:2.0:1788587016.510137:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 247 00000100:00100000:2.0:1788587016.510148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+21:12467:x1875469110712960:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587016.510224:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.510242:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 21 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.510251:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.510298:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 21 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.510324:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 21 pid: 10048 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.510338:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875469127526528:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587016.510465:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa78e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587016.512274:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875469127526528:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587016.512301:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587016.514028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.514404:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110713088 00000100:00100000:1.0:1788587016.514413:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110713088 00010000:00010000:1.0:1788587016.516084:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 22 pid: 10048 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.516176:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 106 00000100:00100000:1.0:1788587016.516188:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+22:2408:x1875469110713088:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587016.516237:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587016.516245:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 22 pid: 10048 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516259:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 22 pid: 10048 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516284:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71800/0xfbc93bbea5fda797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b0e expref: 22 pid: 10048 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516326:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.516333:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 21 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516344:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516351:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516359:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.516399:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587016.516496:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:207b4310-f56a-4e63-b878-60fda37c3e93+21:2408:x1875469110713088:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 310us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.516504:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 106 00010000:00010000:3.0:1788587016.516603:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.516612:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.516793:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.516806:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 21 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.516814:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.516855:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 21 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.516869:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 21 pid: 13553 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587016.516896:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875469127526656:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587016.516957:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e85e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587016.521022:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.521160:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110713216 00000100:00100000:2.0:1788587016.521171:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110713216 00010000:00010000:2.0:1788587016.521212:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 22 pid: 13553 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.521265:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 107 00000100:00100000:2.0:1788587016.521276:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:2409:x1875469110713216:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587016.521291:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587016.521298:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 22 pid: 13553 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.521320:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 22 pid: 13553 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.521362:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:2.0:1788587016.521367:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.521377:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.521385:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.521403:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587016.521493:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:2409:x1875469110713216:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 219us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.521501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 107 00010000:00010000:0.0:1788587016.523176:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b4d expref: 21 pid: 13553 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.523202:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875469127526656:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587016.523287:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.523300:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.523315:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587016.523701:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788587016.523821:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788587016.523859:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788587016.524068:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875469127526784:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587016.524129:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587016.524202:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83279c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587016.524296:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127526784 00000100:00100000:1.0:1788587016.524313:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127526784 00000100:00100000:1.0:1788587016.524394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788587016.524404:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875469127526784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788587016.524540:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875469127526784:12345-0@lo:1000:mdt00_002.0 Request processed in 137us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.524548:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587016.524635:0:6522:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788587016.524641:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1788587016.524665:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a83f88000, transno 4294967322 00000100:00100000:3.0:1788587016.524688:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875469127526784:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788587016.524803:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788587016.524850:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875469127526912:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587016.524883:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587016.525463:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83279c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587016.525599:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127526912 00000100:00100000:0.0:1788587016.525605:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127526912 00000100:00100000:0.0:1788587016.525650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788587016.525658:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875469127526912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587016.525785:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1875469127526912:12345-0@lo:1000:mdt00_002.0 Request processed in 128us (901us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788587016.525793:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587016.525941:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1875469127526912:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788587016.525985:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526007:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526014:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526020:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587016.526025:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526034:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526064:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:3.0:1788587016.526067:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587016.526072:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526079:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda8af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526103:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526109:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526115:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526120:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587016.526123:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526129:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526138:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:3.0:1788587016.526140:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587016.526147:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526159:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526176:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.526205:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 24 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587016.526217:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875469127527040:192.168.203.1@tcp:105: 00000100:00100000:3.0:1788587016.526586:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587016.530202:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1875469127527040:192.168.203.1@tcp:105: 00010000:00010000:1.0:1788587016.530243:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530271:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda7f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530313:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530328:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530340:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530352:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530358:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530365:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530370:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.530374:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530381:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530392:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.530395:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587016.530399:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530447:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda8b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530459:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530465:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530470:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530475:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70c00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587016.530478:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530483:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530492:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587016.530494:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587016.530497:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587016.530503:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70c00/0xfbc93bbea5fda8a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587016.530685:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7cafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+24:12467:x1875469110712960:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 20537us (21008us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788587016.530695:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 247 00000020:00080000:1.0:1788587016.530707:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788587016.534320:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587016.534329:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587016.534990:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788587016.535002:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587016.535978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.536019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110713344 00000100:00100000:1.0:1788587016.536029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110713344 00000100:00100000:1.0:1788587016.536085:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:2.0:1788587016.536086:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127527168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587016.536097:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+24:12466:x1875469110713344:12345-192.168.203.1@tcp:49:lfs.0 00000100:00100000:2.0:1788587016.536141:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587016.536231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+24:12466:x1875469110713344:12345-192.168.203.1@tcp:49:lfs.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587016.536239:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:1.0:1788587016.536353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.536380:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110713600 00000100:00100000:2.0:1788587016.536385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110713600 00000100:00100000:2.0:1788587016.536457:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 62 00000100:00100000:2.0:1788587016.536465:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+24:12467:x1875469110713600:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788587016.536711:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788587016.536753:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788587016.536787:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536804:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536835:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536844:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536851:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536858:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536875:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587016.536907:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587016.536913:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536919:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587016.536922:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536929:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536942:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:2.0:1788587016.536945:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587016.536950:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536957:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587016.536981:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587016.536983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587016.536985:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587016.537022:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c79850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+26:12467:x1875469110713600:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 557us (667us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788587016.537029:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 62 00000020:00080000:2.0:1788587016.537033:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587016.537140:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587016.537153:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127527296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587016.537189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587016.537758:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127527168 00000100:00100000:2.0:1788587016.537766:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127527168 00000100:00100000:2.0:1788587016.537802:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127527296 00000100:00100000:2.0:1788587016.537805:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127527296 00000100:00100000:2.0:1788587016.537837:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788587016.537845:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875469127527168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587016.537864:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788587016.537908:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875469127527168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.537914:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788587016.537927:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788587016.537933:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127527296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587016.537942:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788587016.537965:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127527296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.537970:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788587016.538575:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127527296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587016.538595:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127527168:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587016.538754:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587016.544682:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587016.544705:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127527424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587016.544771:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587016.545004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587016.545122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110713856 00000100:00100000:3.0:1788587016.545130:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110713856 00000100:00100000:3.0:1788587016.545187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 248 00000100:00100000:3.0:1788587016.545196:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+26:12466:x1875469110713856:12345-192.168.203.1@tcp:58:lfs.0 00000100:00100000:2.0:1788587016.545224:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127527424 00000100:00100000:2.0:1788587016.545230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127527424 00000100:00100000:2.0:1788587016.545264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788587016.545273:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127527424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587016.545321:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788587016.545384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127527424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587016.545392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788587016.545538:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127527424:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788587016.545579:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788587016.545748:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+26:12466:x1875469110713856:12345-192.168.203.1@tcp:58:lfs.0 Request processed in 551us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587016.545755:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 248 00000040:00080000:0.0:1788587016.599825:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587016.601351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587016.602338:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110713984 00000100:00100000:0.0:1788587016.602352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110713984 00000100:00100000:0.0:1788587016.602461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 249 00000100:00100000:0.0:1788587016.602471:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+26:12469:x1875469110713984:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788587016.602683:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587016.602716:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda8c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b69 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602780:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602794:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602880:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602896:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602903:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602909:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602985:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.602996:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.603004:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.603036:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.603061:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 27 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587016.603076:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127527552:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587016.603319:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b986fef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587016.607998:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1875469127527552:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587016.608033:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587016.608357:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587016.608718:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110714240 00000100:00100000:1.0:1788587016.608726:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110714240 00000100:00100000:1.0:1788587016.608783:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:1.0:1788587016.608794:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+28:6175:x1875469110714240:12345-192.168.203.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788587016.609201:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+29:6175:x1875469110714240:12345-192.168.203.1@tcp:35:ldlm_bl.0 Request processed in 407us (843us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788587016.609210:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:0.0:1788587016.615641:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587016.623005:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110714368 00000100:00100000:2.0:1788587016.623021:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110714368 00010000:00010000:2.0:1788587016.623301:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 29 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587016.623595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 108 00000100:00100000:3.0:1788587016.623621:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+29:2409:x1875469110714368:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587016.623637:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587016.623644:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 29 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.623658:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 29 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.623681:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71c00/0xfbc93bbea5fda7e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b2a expref: 29 pid: 6520 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.623698:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:3.0:1788587016.623703:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.623713:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.623721:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587016.623755:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587016.623840:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:207b4310-f56a-4e63-b878-60fda37c3e93+28:2409:x1875469110714368:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 222us (8206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587016.623847:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 108 00010000:00010000:0.0:1788587016.624318:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624329:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587016.624382:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788587016.624387:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587016.624438:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624452:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624462:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624470:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624477:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624494:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.624508:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624516:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624529:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:0.0:1788587016.624532:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.624537:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624543:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4a00/0xfbc93bbea5fda8cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624555:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624561:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624567:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624572:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587016.624575:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624581:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624589:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f5b8638e400) 00010000:00010000:0.0:1788587016.624591:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587016.624602:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624608:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5e00/0xfbc93bbea5fda8d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624649:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4600/0xfbc93bbea5fda8c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b69 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624664:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b69 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587016.624671:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:0.0:1788587016.624673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587016.624676:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5800, rc 0) 00000100:00100000:0.0:1788587016.624725:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+27:12469:x1875469110713984:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 22255us (23383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587016.624733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 249 00010000:00010000:3.0:1788587016.661917:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587017.385046:0:14757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587017.385056:0:14757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587017.385091:0:14757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788587017.385097:0:14757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788587017.557166:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587017.557175:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587017.557201:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788587017.557216:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587017.557697:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127527680:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587017.557933:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85169d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587017.568142:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1875469127527680:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587017.570631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587017.570668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110714496 00000100:00100000:1.0:1788587017.570677:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110714496 00000100:00100000:1.0:1788587017.570740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 250 00000100:00100000:1.0:1788587017.570753:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+27:12481:x1875469110714496:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587017.570786:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587017.570891:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+27:12481:x1875469110714496:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587017.570913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 250 00000100:00080000:1.0:1788587017.570937:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587017.587963:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587017.588043:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110714752 00000100:00100000:1.0:1788587017.588052:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110714752 00000100:00100000:1.0:1788587017.588109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 251 00000100:00100000:1.0:1788587017.588120:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+27:12481:x1875469110714752:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587017.588138:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587017.588155:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda8e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b70 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587017.588257:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda8e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587017.588272:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587017.588285:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587017.588296:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788587017.588458:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466800/0xfbc93bbea5fda8e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b70 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587017.588474:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b70 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587017.588484:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587017.588487:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587017.588500:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466600, rc 0) 00000100:00100000:1.0:1788587017.588562:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+29:12481:x1875469110714752:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 444us (608us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788587017.588570:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 251 00000100:00100000:0.0:1788587017.596381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587017.596618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110715008 00000100:00100000:2.0:1788587017.596629:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110715008 00000100:00100000:2.0:1788587017.596691:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 252 00000100:00100000:2.0:1788587017.596720:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+29:12481:x1875469110715008:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587017.596806:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.596824:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.596853:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597010:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597018:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597025:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597031:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587017.597035:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597043:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597054:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:2.0:1788587017.597057:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587017.597061:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587017.597067:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70400/0xfbc93bbea5fda8f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587017.597189:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+30:12481:x1875469110715008:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 489us (818us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788587017.597198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 252 00000100:00100000:1.0:1788587017.598654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587017.598730:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110715136 00000100:00100000:3.0:1788587017.598738:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110715136 00000100:00100000:3.0:1788587017.598794:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:3.0:1788587017.598804:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:2409:x1875469110715136:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587017.598818:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587017.598837:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466600/0xfbc93bbea5fda8e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b70 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587017.598854:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:3.0:1788587017.598858:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587017.598900:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:207b4310-f56a-4e63-b878-60fda37c3e93+29:2409:x1875469110715136:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.598907:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000040:00080000:0.0:1788587017.599061:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587017.599066:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587017.599755:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788587017.599767:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587017.605953:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587017.606043:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110715392 00000100:00100000:1.0:1788587017.606052:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110715392 00000100:00100000:1.0:1788587017.606113:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:1.0:1788587017.606126:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+29:12481:x1875469110715392:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788587017.606351:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+30:12481:x1875469110715392:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 227us (407us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788587017.606359:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 64 00010000:00010000:3.0:1788587017.684783:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587018.071367:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587018.071391:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127527808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587018.071492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587018.071767:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127527808 00000100:00100000:1.0:1788587018.071776:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127527808 00000100:00100000:1.0:1788587018.071830:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788587018.071840:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127527808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587018.071874:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788587018.071929:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127527808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587018.071937:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788587018.072024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127527808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587018.581173:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127528320:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581259:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587018.581330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581356:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587018.581371:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127529344:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581392:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587018.581439:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788587018.581446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127528192:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587018.581487:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127528704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581507:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587018.581521:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127529216:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581540:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587018.581566:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528832 00000100:00100000:0.0:1788587018.581573:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528832 00000100:00100000:0.0:1788587018.581614:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529344 00000100:00100000:0.0:1788587018.581617:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529344 00000100:00100000:0.0:1788587018.581629:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528704 00000100:00100000:0.0:1788587018.581631:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528704 00000100:00100000:0.0:1788587018.581644:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529216 00000100:00100000:0.0:1788587018.581646:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529216 00000100:00100000:0.0:1788587018.581660:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788587018.581668:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875469127528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581721:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875469127528832:12345-0@lo:400:kworker.0 Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587018.581727:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788587018.581742:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788587018.581748:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127529344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581772:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127529344:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587018.581785:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788587018.581796:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788587018.581802:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127528704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581828:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127528704:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587018.581834:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788587018.581843:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587018.581848:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127529216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581869:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127529216:12345-0@lo:400:kworker.0 Request processed in 21us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587018.581874:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587018.581904:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127528704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127529216:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788587018.581930:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127529344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582195:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127528064:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.582271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127528576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.582320:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127529088:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582345:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.582367:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788587018.582373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127527936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582412:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.582475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127528448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.582515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127528960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582533:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587018.582558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127527936 00000100:00100000:3.0:1788587018.582563:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127527936 00000100:00100000:3.0:1788587018.582600:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788587018.582607:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127527936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.582619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528320 00000100:00100000:2.0:1788587018.582626:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528320 00000100:00100000:3.0:1788587018.582648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127527936:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.582656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788587018.582661:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788587018.582671:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528192 00000100:00100000:3.0:1788587018.582693:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528192 00000100:00100000:3.0:1788587018.582716:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528064 00000100:00100000:3.0:1788587018.582719:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528064 00000100:00100000:2.0:1788587018.582724:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127528320:12345-0@lo:400:kworker.0 Request processed in 55us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.582730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528576 00000100:00100000:2.0:1788587018.582733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788587018.582735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528576 00000100:00100000:3.0:1788587018.582754:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529088 00000100:00100000:3.0:1788587018.582757:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529088 00000100:00100000:3.0:1788587018.582772:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528448 00000100:00100000:3.0:1788587018.582774:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528448 00000100:00100000:2.0:1788587018.582776:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127528320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127528960 00000100:00100000:3.0:1788587018.582793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127528960 00000100:00100000:3.0:1788587018.582814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788587018.582822:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127528192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.582847:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788587018.582857:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127528064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582865:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127528192:12345-0@lo:400:kworker.0 Request processed in 42us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.582882:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788587018.582900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127528064:12345-0@lo:400:kworker.0 Request processed in 44us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.582905:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788587018.582914:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788587018.582919:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127528576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.582936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788587018.582945:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127529088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.582958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127528576:12345-0@lo:400:kworker.0 Request processed in 43us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.582965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788587018.582984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127529088:12345-0@lo:400:kworker.0 Request processed in 40us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587018.582995:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788587018.583072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587018.583102:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127528448:12345-0@lo:400:kworker.0 Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587018.589453:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788587018.589514:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788587018.589532:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.590739:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127528960:12345-0@lo:400:kworker.0 Request processed in 110us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587018.590770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788587018.590945:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127528192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.590985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127527936:0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.590996:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127528448:0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.591006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127528960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587018.591016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127528064:0@lo:400:kworker.0 00010000:00080000:2.0:1788587018.591028:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83f01c00 x1875469127528576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587018.591039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127528576:0@lo:400:kworker.0 00010000:00080000:2.0:1788587018.591051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83f03480 x1875469127529088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587018.591060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127529088:0@lo:400:kworker.0 00000100:00080000:2.0:1788587018.591107:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587018.591112:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587018.591116:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587018.591118:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587018.596701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00010000:2.0:1788587018.708574:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587019.288073:0:14808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587019.288084:0:14808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587019.288118:0:14808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788587019.288125:0:14808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587019.502351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587019.502469:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110715648 00000100:00100000:1.0:1788587019.502480:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110715648 00000100:00080000:2.0:1788587019.502513:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587019.502552:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 253 00000100:00100000:1.0:1788587019.502563:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+30:12501:x1875469110715648:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587019.502592:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587019.502614:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda8fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b77 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.502749:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda903 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.502763:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.502777:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587019.502787:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788587019.502895:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda8fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b77 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.502912:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b77 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.502920:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587019.502923:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587019.502926:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466400, rc 0) 00000100:00100000:1.0:1788587019.502991:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:207b4310-f56a-4e63-b878-60fda37c3e93+32:12501:x1875469110715648:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 430us (652us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788587019.502999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 253 00000100:00100000:0.0:1788587019.509371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587019.510190:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110715776 00000100:00100000:1.0:1788587019.510202:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110715776 00000100:00100000:1.0:1788587019.510267:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 254 00000100:00100000:1.0:1788587019.510277:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+32:12501:x1875469110715776:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788587019.510351:0:10048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510379:0:10048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510391:0:10048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510450:0:10048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510457:0:10048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510464:0:10048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510469:0:10048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587019.510474:0:10048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510481:0:10048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510492:0:10048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587019.510495:0:10048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587019.510500:0:10048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587019.510506:0:10048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467a00/0xfbc93bbea5fda911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587019.510577:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+32:12501:x1875469110715776:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 301us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.510590:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 254 00000100:00100000:0.0:1788587019.609867:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587019.612704:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110715904 00000100:00100000:2.0:1788587019.612724:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110715904 00000100:00080000:1.0:1788587019.612895:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587019.612958:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:2.0:1788587019.612971:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+7:2408:x1875469110715904:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:2.0:1788587019.613002:0:10047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587019.613023:0:10047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ef9d7f4/0xfbc93bbea5fda918 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b7e expref: -99 pid: 10047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587019.613052:0:10047:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9bac08, atime: 0x6a9bac07, ctime: 0x6a9bac08, blocks: 0x8 00010000:00010000:2.0:1788587019.613082:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1788587019.613088:0:10047:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587019.613097:0:10047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ef9d7f4/0xfbc93bbea5fda918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b7e expref: 8 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.613116:0:10047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ef9d7f4/0xfbc93bbea5fda918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b7e expref: 8 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.613135:0:10047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70e00, rc 0) 00000100:00100000:2.0:1788587019.613253:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110715904:12345-192.168.203.1@tcp:101:cat.0 Request processed in 285us (3394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587019.613260:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:2.0:1788587019.624028:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587019.624217:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716032 00000100:00100000:1.0:1788587019.624228:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716032 00002000:00100000:1.0:1788587019.624278:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8f5a83e81180 x1875469110716032/t0(0) o3->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:335/0 lens 488/0 e 0 to 0 dl 1788587030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587019.624298:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83e81180 with x1875469110716032 ext(0->4095) 00002000:00010000:1.0:1788587019.624304:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83e81180 00000100:00100000:1.0:1788587019.624341:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:1.0:1788587019.624350:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110716032:12345-192.168.203.1@tcp:3:cat.0 00000100:00100000:1.0:1788587019.624554:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2409:x1875469110716032:12345-192.168.203.1@tcp:3:cat.0 Request processed in 205us (537us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788587019.624562:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00002000:00100000:1.0:1788587019.624569:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8f5a83e81180 x1875469110716032/t0(0) o3->207b4310-f56a-4e63-b878-60fda37c3e93@192.168.203.1@tcp:335/0 lens 488/4536 e 0 to 0 dl 1788587030 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788587019.624577:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f5a83e81180 with x1875469110716032 ext(0->4095) 00002000:00010000:1.0:1788587019.624581:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f5a83e81180 00010000:00010000:3.0:1788587019.732870:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587020.628860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127529472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587020.628942:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587020.629562:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529472 00000100:00100000:1.0:1788587020.629572:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529472 00000100:00100000:1.0:1788587020.629633:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788587020.629643:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587020.629645:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127529472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587020.629676:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788587020.629734:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127529472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.629751:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788587020.630025:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127529472:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788587020.632499:0:10054:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366563080576ns, next at 367563077884ns, rc = 0 00000100:00100000:0.0:1788587020.632587:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587020.632620:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127529600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587020.632683:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587020.633006:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529600 00000100:00100000:2.0:1788587020.633015:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529600 00000100:00100000:2.0:1788587020.633091:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788587020.633101:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127529600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587020.633130:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788587020.633288:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127529600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587020.633295:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788587020.633322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587020.633359:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127529600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587020.756802:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587020.908080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908146:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908182:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908225:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587020.908272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716672 00000100:00100000:1.0:1788587020.908293:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716672 00000100:00100000:1.0:1788587020.908339:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716544 00000100:00100000:1.0:1788587020.908343:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716544 00000100:00100000:1.0:1788587020.908375:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 130 00000100:00100000:1.0:1788587020.908385:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110716672:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587020.908480:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+8:2408:x1875469110716672:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.908501:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 130 00000100:00100000:1.0:1788587020.908518:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 131 00000100:00100000:1.0:1788587020.908525:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5baf361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110716544:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587020.908549:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5baf361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110716544:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.908555:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 131 00000100:00100000:1.0:1788587020.908692:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716416 00000100:00100000:1.0:1788587020.908696:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716416 00000100:00100000:1.0:1788587020.908721:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716928 00000100:00100000:1.0:1788587020.908734:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716928 00000100:00100000:1.0:1788587020.908751:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716288 00000100:00100000:1.0:1788587020.908754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716288 00000100:00100000:1.0:1788587020.908779:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716800 00000100:00100000:1.0:1788587020.908782:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716800 00000100:00100000:1.0:1788587020.908798:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 295 00000100:00100000:1.0:1788587020.908804:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110716416:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587020.908835:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2408:x1875469110716416:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 30us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.908841:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 295 00000100:00100000:1.0:1788587020.908853:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 296 00000100:00100000:1.0:1788587020.908859:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110716928:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587020.908880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110716928:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.908886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 296 00000100:00100000:1.0:1788587020.908895:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 297 00000100:00100000:1.0:1788587020.908900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+32:2408:x1875469110716288:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587020.908921:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+32:2408:x1875469110716288:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 21us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.908932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 297 00000100:00100000:1.0:1788587020.908942:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 298 00000100:00100000:1.0:1788587020.908948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110716800:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587020.908969:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2408:x1875469110716800:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 21us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587020.908974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 298 00000100:00080000:1.0:1788587020.909012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587020.909016:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587020.909019:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587020.910188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110716160 00000100:00100000:2.0:1788587020.910196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110716160 00000100:00100000:2.0:1788587020.910244:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 384 00000100:00100000:2.0:1788587020.910252:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110716160:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587020.910310:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8f020805-49be-45a9-ab90-7695d6719484+13:2408:x1875469110716160:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 59us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587020.910317:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 384 00000100:00100000:3.0:1788587021.653448:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587021.653473:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127529728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587021.653865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587021.653988:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529728 00000100:00100000:3.0:1788587021.653996:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529728 00000100:00100000:3.0:1788587021.654049:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788587021.654058:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127529728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587021.654085:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788587021.654126:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127529728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587021.654144:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788587021.654168:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127529856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587021.654198:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587021.654238:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127529728:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788587021.654260:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587021.654281:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529856 00000100:00100000:1.0:1788587021.654286:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529856 00000100:00100000:1.0:1788587021.654322:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587021.654330:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127529856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587021.654352:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788587021.654986:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127529856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 655us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587021.654995:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587021.656312:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587021.656332:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127529984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587021.656399:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587021.656637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127529856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587021.657037:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127529984 00000100:00100000:2.0:1788587021.657046:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127529984 00000100:00100000:2.0:1788587021.657112:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788587021.657122:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875469127529984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587021.657153:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788587021.657208:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875469127529984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587021.657216:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788587021.657459:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587021.658840:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127529984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788587021.781051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788587022.172963:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788587022.172979:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788587022.174254:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:2.0:1788587022.185932:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1788587022.185973:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1788587022.186001:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f5bb4e85180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788587022.186006:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83d51a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f5bb4e85d80 00000020:00080000:2.0:1788587022.186017:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f5a83d51c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f5a83551600 00000020:00080000:2.0:1788587022.186038:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:0.0:1788587022.189642:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127530112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788587022.189714:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587022.189792:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530112 00000100:00100000:0.0:1788587022.189800:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530112 00000100:00100000:0.0:1788587022.189855:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788587022.189865:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127530112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788587022.190005:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788587022.190009:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788587016 -> 1788587016 00002000:00010000:0.0:1788587022.190012:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788587015 -> 1788587015 00002000:00010000:0.0:1788587022.190015:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788587016 -> 1788587016 00002000:00010000:0.0:1788587022.190018:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788587022.190060:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127530112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (346us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788587022.190068:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788587022.190089:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587022.190132:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788587022.190137:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788587022.190160:0:3647:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f5a83de0e00 x1875469127530112/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788587038 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788587022.190186:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5a83de0e00/2, rc 0, transno 4294967325 00000100:00100000:0.0:1788587022.190192:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127530112:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788587022.190441:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587022.190452:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587022.190460:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587022.190467:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587022.190472:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587022.190480:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587022.190496:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f5a83482700) 00010000:00010000:2.0:1788587022.190500:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587022.190504:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587022.190510:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fda893 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13553 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788587022.190539:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788587022.190596:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788587022.804690:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587023.189515:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587023.189552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127530240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587023.189628:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587023.190001:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530240 00000100:00100000:1.0:1788587023.190011:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530240 00000100:00100000:1.0:1788587023.190056:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788587023.190066:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127530240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587023.190101:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788587023.190159:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127530240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587023.190166:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788587023.190375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127530240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587023.703407:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703529:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.703571:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127530880:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703611:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.703634:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127531392:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703655:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.703678:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788587023.703684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127530752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703708:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.703725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127531264:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.703764:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127531776:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703783:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587023.703813:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530368 00000100:00100000:2.0:1788587023.703820:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530368 00000100:00100000:2.0:1788587023.703862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788587023.703870:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127530368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.703916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127530368:12345-0@lo:400:kworker.0 Request processed in 47us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.703923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788587023.703955:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530880 00000100:00100000:2.0:1788587023.703959:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530880 00000100:00100000:2.0:1788587023.703993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531392 00000100:00100000:2.0:1788587023.703996:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531392 00000100:00100000:2.0:1788587023.704019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788587023.704036:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127530880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127530880:12345-0@lo:400:kworker.0 Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.704075:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788587023.704088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788587023.704094:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127531392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704119:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127531392:12345-0@lo:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.704125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788587023.704145:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530752 00000100:00100000:2.0:1788587023.704149:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530752 00000100:00100000:2.0:1788587023.704173:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788587023.704179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127530752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127530752:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.704229:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788587023.704247:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531264 00000100:00100000:2.0:1788587023.704251:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531264 00000100:00100000:2.0:1788587023.704492:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531776 00000100:00100000:2.0:1788587023.704497:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531776 00000100:00100000:2.0:1788587023.704520:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788587023.704526:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127531264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704557:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127531264:12345-0@lo:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.704564:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788587023.704576:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788587023.704582:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127531776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704676:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127531776:12345-0@lo:400:kworker.0 Request processed in 94us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587023.704683:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1788587023.704706:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587023.704710:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587023.704752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127530752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704762:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788587023.704767:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788587023.704795:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a83f89880, transno 4294967311 00000100:00100000:2.0:1788587023.704808:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127531264:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704820:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127531776:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704828:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704837:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127530880:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.704846:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127531392:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705037:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127530496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705073:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.705099:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127531008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705119:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.705135:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127531520:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705153:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.705169:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587023.705175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127530624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705196:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.705221:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127531136:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705241:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.705405:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127531648:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705451:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587023.705483:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530496 00000100:00100000:3.0:1788587023.705489:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530496 00000100:00100000:3.0:1788587023.705513:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531008 00000100:00100000:3.0:1788587023.705516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531008 00000100:00100000:3.0:1788587023.705545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531520 00000100:00100000:3.0:1788587023.705548:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531520 00000100:00100000:3.0:1788587023.705559:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127530624 00000100:00100000:3.0:1788587023.705562:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127530624 00000100:00100000:3.0:1788587023.705573:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788587023.705579:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127530496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705694:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127530496:12345-0@lo:400:kworker.0 Request processed in 114us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.705701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788587023.705715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788587023.705722:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127531008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127531008:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.705756:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788587023.705767:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788587023.705772:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127531520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705797:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127531520:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.705803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788587023.705814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788587023.705820:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705846:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127530624:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587023.705851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788587023.705879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127530624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.705887:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127530496:0@lo:400:kworker.0 00010000:00080000:3.0:1788587023.705907:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a845ef800 x1875469127531008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587023.705917:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127531008:0@lo:400:kworker.0 00010000:00080000:3.0:1788587023.705926:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5ba7a19f80 x1875469127531520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587023.705934:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127531520:0@lo:400:kworker.0 00000100:00100000:2.0:1788587023.706181:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531136 00000100:00100000:2.0:1788587023.706186:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531136 00000100:00100000:2.0:1788587023.709322:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531648 00000100:00100000:2.0:1788587023.709334:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531648 00000100:00100000:0.0:1788587023.709948:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788587023.709964:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127531136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587023.710052:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127531136:12345-0@lo:400:kworker.0 Request processed in 94us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.710060:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788587023.710089:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788587023.710096:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127531648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587023.710128:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127531648:12345-0@lo:400:kworker.0 Request processed in 33us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587023.710133:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788587023.711898:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127531136:0@lo:400:kworker.0 00000100:00100000:3.0:1788587023.711915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127531648:0@lo:400:kworker.0 00000100:00080000:3.0:1788587023.714717:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587023.714727:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587023.714731:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788587023.830445:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587024.079746:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587024.079893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717056 00000100:00100000:3.0:1788587024.079902:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717056 00000100:00100000:3.0:1788587024.079984:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 255 00000100:00100000:3.0:1788587024.079994:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+18:12146:x1875469110717056:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788587024.080087:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:207b4310-f56a-4e63-b878-60fda37c3e93+18:12146:x1875469110717056:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587024.080093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 255 00000100:00080000:2.0:1788587024.080579:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587024.083779:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587024.083977:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717184 00000100:00100000:2.0:1788587024.083987:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717184 00000100:00100000:2.0:1788587024.084083:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 256 00000100:00100000:2.0:1788587024.084094:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:12146:x1875469110717184:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788587024.084203:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:12146:x1875469110717184:12345-192.168.203.1@tcp:60:lhsmtool_posix.0 Request processed in 111us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587024.084228:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 256 00000100:00080000:3.0:1788587024.085764:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587024.105977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587024.106076:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717440 00000100:00100000:2.0:1788587024.106085:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717440 00000100:00100000:2.0:1788587024.106138:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:2.0:1788587024.106148:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:12146:x1875469110717440:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587024.106739:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:12146:x1875469110717440:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 591us (768us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788587024.106747:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 65 00000100:00100000:1.0:1788587024.536924:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587024.537004:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717568 00000100:00100000:3.0:1788587024.537017:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717568 00000100:00100000:3.0:1788587024.537125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 257 00000100:00100000:3.0:1788587024.537137:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:12958:x1875469110717568:12345-192.168.203.1@tcp:101:lsof.0 00010000:00010000:3.0:1788587024.537159:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587024.537212:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda91f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b85 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587024.537296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda926 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587024.537312:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587024.537326:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587024.537604:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788587024.537609:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587024.537635:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587024.537660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a400/0xfbc93bbea5fda91f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b85 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587024.537677:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b85 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587024.537686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:3.0:1788587024.537688:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587024.537692:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1a200, rc 0) 00000100:00100000:3.0:1788587024.537753:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:12958:x1875469110717568:12345-192.168.203.1@tcp:101:lsof.0 Request processed in 618us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587024.537760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 257 00000100:00080000:2.0:1788587024.537918:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587024.854093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587025.748875:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587025.748900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127531904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587025.748971:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587025.749239:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127531904 00000100:00100000:3.0:1788587025.749270:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127531904 00000100:00100000:3.0:1788587025.749335:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788587025.749345:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127531904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587025.749375:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788587025.749453:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127531904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587025.749460:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788587025.749480:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587025.749489:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127532032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587025.749515:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587025.749570:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127531904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587025.750174:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532032 00000100:00100000:0.0:1788587025.750180:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532032 00000100:00100000:0.0:1788587025.750219:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587025.750226:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127532032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587025.750238:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788587025.750290:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875469127532032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587025.750297:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587025.750329:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127532032:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788587025.750458:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788587025.876690:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587026.024081:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587026.024135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587026.024160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587026.024198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587026.024215:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587026.024229:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587026.024260:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587026.024543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717696 00000100:00100000:3.0:1788587026.024552:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717696 00000100:00100000:3.0:1788587026.024606:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 386 00000100:00100000:3.0:1788587026.024617:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2407:x1875469110717696:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587026.024697:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+13:2407:x1875469110717696:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 81us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587026.024705:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 386 00000100:00100000:3.0:1788587026.025552:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718080 00000100:00100000:3.0:1788587026.025559:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718080 00000100:00100000:3.0:1788587026.025604:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718208 00000100:00100000:3.0:1788587026.025608:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718208 00000100:00100000:3.0:1788587026.025632:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 136 00000100:00100000:3.0:1788587026.025640:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110718080:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587026.025693:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110718080:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 53us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587026.025794:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:0.0:1788587026.025806:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2407:x1875469110718208:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587026.025822:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 136 00000100:00100000:0.0:1788587026.025847:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2407:x1875469110718208:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 44us (1616us total) trans 0 rc 0/0 00000100:00080000:3.0:1788587026.025848:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587026.025854:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587026.025860:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:3.0:1788587026.025867:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717824 00000100:00100000:3.0:1788587026.025872:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717824 00000100:00100000:0.0:1788587026.025890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718336 00000100:00100000:0.0:1788587026.025897:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718336 00000100:00100000:3.0:1788587026.025909:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110717952 00000100:00100000:3.0:1788587026.025913:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110717952 00000100:00100000:0.0:1788587026.025929:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718464 00000100:00100000:0.0:1788587026.025935:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718464 00000100:00100000:3.0:1788587026.025939:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 305 00000100:00100000:3.0:1788587026.025948:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+19:2407:x1875469110717824:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587026.025975:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 306 00000100:00100000:0.0:1788587026.025984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2407:x1875469110718336:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587026.025991:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+19:2407:x1875469110717824:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 42us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587026.025999:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 305 00000100:00100000:3.0:1788587026.026014:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 307 00000100:00100000:0.0:1788587026.026022:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2407:x1875469110718336:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 38us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587026.026024:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110717952:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587026.026035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 306 00000100:00100000:0.0:1788587026.026054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 308 00000100:00100000:3.0:1788587026.026059:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+5:2407:x1875469110717952:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 36us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587026.026067:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2407:x1875469110718464:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587026.026071:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 307 00000100:00080000:3.0:1788587026.026090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587026.026093:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587026.026104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2407:x1875469110718464:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 40us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587026.026111:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 308 00000100:00100000:3.0:1788587026.775546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587026.775569:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127532160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587026.775634:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587026.775960:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587026.775970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127532288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587026.776000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587026.776044:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532288 00000100:00100000:2.0:1788587026.776051:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532288 00000100:00100000:2.0:1788587026.776101:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788587026.776108:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127532288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587026.776134:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788587026.776172:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127532288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587026.776177:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788587026.776217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127532288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587026.776581:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587026.776700:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532160 00000100:00100000:1.0:1788587026.776706:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532160 00000100:00100000:1.0:1788587026.776749:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788587026.776757:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127532160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587026.776780:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788587026.776821:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127532160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587026.776826:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788587026.776943:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127532160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587026.776959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587026.776966:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127532416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587026.777007:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587026.777192:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532416 00000100:00100000:1.0:1788587026.777196:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532416 00000100:00100000:1.0:1788587026.777250:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788587026.777264:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127532416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587026.777277:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788587026.777312:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127532416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587026.777319:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788587026.777347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127532416:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788587026.777556:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788587026.836721:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587026.836742:0:13797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587026.837034:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788587026.837042:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788587026.838245:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587026.901219:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788587027.798669:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788587027.798682:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788587027.798730:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788587027.798742:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788587027.805581:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:1.0:1788587027.927635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587027.995844:0:15005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:43:46 (1788587026) 00000100:00100000:3.0:1788587028.313579:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587028.313606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127532544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587028.313682:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.317641:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532544 00000100:00100000:2.0:1788587028.317656:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532544 00000100:00100000:2.0:1788587028.317712:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788587028.317722:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127532544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587028.317762:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788587028.317858:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127532544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.317866:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788587028.317924:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127532544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587028.820835:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127532672:0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.820912:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.820957:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127533184:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821077:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127532800:0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.821321:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127533056:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821389:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.821445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127533312:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821470:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.821488:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127533824:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821509:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.821533:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587028.821539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127532928:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821560:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.821577:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127533440:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821598:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.821614:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127533952:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821634:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587028.821667:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532672 00000100:00100000:2.0:1788587028.821675:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532672 00000100:00100000:2.0:1788587028.821723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788587028.821732:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127532672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821802:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3647:x1875469127532672:12345-0@lo:400:kworker.0 Request processed in 71us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.821809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788587028.821840:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532800 00000100:00100000:2.0:1788587028.821843:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532800 00000100:00100000:2.0:1788587028.821868:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533312 00000100:00100000:2.0:1788587028.821871:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533312 00000100:00100000:2.0:1788587028.821893:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533824 00000100:00100000:2.0:1788587028.821896:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533824 00000100:00100000:2.0:1788587028.821909:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127532928 00000100:00100000:2.0:1788587028.821911:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127532928 00000100:00100000:2.0:1788587028.821921:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788587028.821925:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127532800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.821961:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127532800:12345-0@lo:400:kworker.0 Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.821967:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788587028.821989:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788587028.821996:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822021:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127533312:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.822027:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788587028.822037:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788587028.822043:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127533824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822067:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127533824:12345-0@lo:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.822073:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788587028.822084:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788587028.822097:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127532928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822138:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127532928:12345-0@lo:400:kworker.0 Request processed in 41us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.822144:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788587028.822190:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533440 00000100:00100000:2.0:1788587028.822194:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533440 00000100:00100000:2.0:1788587028.822218:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533952 00000100:00100000:2.0:1788587028.822220:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533952 00000100:00100000:2.0:1788587028.822252:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587028.822258:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127533440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822288:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127533440:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.822294:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587028.822305:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788587028.822311:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127533952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822335:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127533952:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587028.822340:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1788587028.822362:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587028.822365:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587028.822367:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587028.822395:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127532928:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822403:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127533440:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127533952:0@lo:400:kworker.0 00000100:00100000:2.0:1788587028.822439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127532800:0@lo:400:kworker.0 00010000:00080000:2.0:1788587028.822461:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a845ef100 x1875469127533312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587028.822471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127533312:0@lo:400:kworker.0 00010000:00080000:2.0:1788587028.822480:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465180 x1875469127533824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587028.822488:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127533824:0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.827705:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.828086:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127533568:0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828137:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.828169:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127534080:0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828192:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587028.828258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533056 00000100:00100000:1.0:1788587028.828267:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533056 00000100:00100000:1.0:1788587028.828313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788587028.828322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127533056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828377:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127533056:12345-0@lo:400:kworker.0 Request processed in 56us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587028.828384:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788587028.828409:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533568 00000100:00100000:1.0:1788587028.828413:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533568 00000100:00100000:1.0:1788587028.828465:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534080 00000100:00100000:1.0:1788587028.828468:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534080 00000100:00100000:1.0:1788587028.828490:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587028.828497:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127533568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828524:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127533568:12345-0@lo:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587028.828529:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788587028.828554:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788587028.828559:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127534080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828582:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127534080:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587028.828587:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788587028.828603:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587028.828606:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587028.828651:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127533056:0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828660:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127533568:0@lo:400:kworker.0 00000100:00100000:1.0:1788587028.828666:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788587028.828670:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5a83de0e00, transno 4294967325 00000100:00100000:1.0:1788587028.828680:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127534080:0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.829304:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.829348:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127533696:0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.829381:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587028.829412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127532672:0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.829468:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533184 00000100:00100000:3.0:1788587028.829473:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533184 00000100:00100000:3.0:1788587028.829516:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127533696 00000100:00100000:3.0:1788587028.829519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127533696 00000100:00100000:3.0:1788587028.829541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788587028.829548:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127533184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.829588:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127533184:12345-0@lo:400:kworker.0 Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.829595:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788587028.829609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788587028.829615:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.829640:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127533696:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587028.829653:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:3.0:1788587028.829671:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587028.829689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127533184:0@lo:400:kworker.0 00000100:00100000:3.0:1788587028.829699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127533696:0@lo:400:kworker.0 00010000:00010000:3.0:1788587028.948628:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587029.972716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587030.868687:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587030.868711:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127534208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587030.868782:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587030.868926:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534208 00000100:00100000:2.0:1788587030.868934:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534208 00000100:00100000:2.0:1788587030.868996:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788587030.869006:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127534208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587030.869032:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788587030.869076:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127534208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587030.869083:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788587030.869170:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127534208:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788587030.869233:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587030.869455:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587030.869467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127534336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587030.869498:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587030.869574:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534336 00000100:00100000:0.0:1788587030.869579:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534336 00000100:00100000:0.0:1788587030.869626:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788587030.869634:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127534336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587030.869646:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788587030.869682:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127534336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587030.869688:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788587030.869719:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127534336:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788587030.869777:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788587030.996685:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587031.146138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.146186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.146225:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.146253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.146270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.146287:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587031.146326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718848 00000100:00100000:2.0:1788587031.146335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718592 00000100:00100000:0.0:1788587031.146336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718848 00000100:00100000:2.0:1788587031.146338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718592 00000100:00100000:2.0:1788587031.146383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 388 00000100:00100000:0.0:1788587031.146386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110719360 00000100:00100000:2.0:1788587031.146393:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110718592:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587031.146404:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110719360 00000100:00100000:0.0:1788587031.146449:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718720 00000100:00100000:0.0:1788587031.146452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718720 00000100:00100000:0.0:1788587031.146467:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 315 00000100:00100000:0.0:1788587031.146473:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110718848:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587031.146595:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110719104 00000100:00100000:3.0:1788587031.146599:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110719104 00000100:00100000:3.0:1788587031.146629:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110718976 00000100:00100000:3.0:1788587031.146632:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110718976 00000100:00100000:3.0:1788587031.146654:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 142 00000100:00100000:3.0:1788587031.146660:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110719104:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587031.147699:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8f020805-49be-45a9-ab90-7695d6719484+13:2409:x1875469110718592:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 1302us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.147709:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 388 00000100:00100000:2.0:1788587031.147777:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 316 00000100:00100000:2.0:1788587031.147786:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110719360:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587031.147817:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2409:x1875469110719360:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 34us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.147834:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 316 00000100:00100000:2.0:1788587031.147849:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 317 00000100:00100000:2.0:1788587031.147855:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110718720:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587031.147881:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:207b4310-f56a-4e63-b878-60fda37c3e93+18:2409:x1875469110718720:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 26us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.147887:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 317 00000100:00080000:2.0:1788587031.147911:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587031.147914:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587031.147917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587031.147919:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587031.147933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 143 00000100:00100000:2.0:1788587031.147939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110718976:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587031.147960:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110718976:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.147966:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 143 00000100:00100000:0.0:1788587031.150822:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2409:x1875469110718848:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 4337us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.150836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 315 00000100:00100000:1.0:1788587031.153142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.153244:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110719232 00000100:00100000:2.0:1788587031.153254:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110719232 00000100:00100000:2.0:1788587031.153373:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 318 00000100:00100000:2.0:1788587031.153383:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110719232:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587031.153496:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2409:x1875469110719232:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 114us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.153504:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 318 00000100:00100000:3.0:1788587031.153884:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:207b4310-f56a-4e63-b878-60fda37c3e93+7:2409:x1875469110719104:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 7221us (7655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.153894:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 142 00000100:00080000:0.0:1788587031.157429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587031.207094:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.207195:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110719616 00000100:00100000:2.0:1788587031.207215:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110719616 00000100:00100000:2.0:1788587031.207278:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:2.0:1788587031.207295:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+18:13181:x1875469110719616:12345-192.168.203.1@tcp:35:umount.0 00000100:00100000:2.0:1788587031.207614:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:13181:x1875469110719616:12345-192.168.203.1@tcp:35:umount.0 Request processed in 321us (529us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788587031.207622:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 66 00000100:00100000:2.0:1788587031.211392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.211682:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110719872 00000100:00100000:1.0:1788587031.211693:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110719872 00000100:00100000:1.0:1788587031.211752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:1.0:1788587031.211763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+19:13181:x1875469110719872:12345-192.168.203.1@tcp:35:umount.0 00000100:00100000:1.0:1788587031.212053:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+20:13181:x1875469110719872:12345-192.168.203.1@tcp:35:umount.0 Request processed in 290us (669us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788587031.212061:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 67 00000100:00100000:3.0:1788587031.216772:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.216876:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110720128 00000100:00100000:1.0:1788587031.216885:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110720128 00000100:00100000:1.0:1788587031.216940:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 68 00000100:00100000:1.0:1788587031.216950:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b86c79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+20:13181:x1875469110720128:12345-192.168.203.1@tcp:35:umount.0 00000100:00100000:1.0:1788587031.217261:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b86c79c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:207b4310-f56a-4e63-b878-60fda37c3e93+21:13181:x1875469110720128:12345-192.168.203.1@tcp:35:umount.0 Request processed in 310us (496us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788587031.217269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 68 00000100:00100000:2.0:1788587031.220962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587031.221172:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110720384 00000100:00100000:0.0:1788587031.221182:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110720384 00000100:00100000:0.0:1788587031.221244:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:0.0:1788587031.221253:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+21:13181:x1875469110720384:12345-192.168.203.1@tcp:35:umount.0 00000100:00100000:0.0:1788587031.222048:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:207b4310-f56a-4e63-b878-60fda37c3e93+22:13181:x1875469110720384:12345-192.168.203.1@tcp:35:umount.0 Request processed in 793us (1091us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788587031.222058:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 69 00000100:00100000:2.0:1788587031.225022:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587031.225102:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110720512 00000100:00100000:3.0:1788587031.225111:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110720512 00000100:00100000:3.0:1788587031.225186:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:3.0:1788587031.225196:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+13:2407:x1875469110720512:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587031.225222:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587031.225241:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd400/0xfbc93bbea5fd987f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106d8 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.225272:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587031.227811:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+12:2407:x1875469110720512:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 2604us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.227825:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:2.0:1788587031.228473:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.228589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.228623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.228648:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110721152 00000100:00100000:2.0:1788587031.228656:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110721152 00000100:00100000:2.0:1788587031.228694:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 80 00000100:00100000:2.0:1788587031.228702:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+7:2405:x1875469110721152:12345-192.168.203.1@tcp:9:umount.0 00000020:00000080:2.0:1788587031.228729:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9e8a 00000020:00010000:2.0:1788587031.228738:0:8434:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f5a83eb5800: total 0 00000100:00080000:2.0:1788587031.228742:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8f5a83eb3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587031.228782:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788587031.228918:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2405:x1875469110721152:12345-192.168.203.1@tcp:9:umount.0 Request processed in 215us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587031.228925:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 80 00000100:00100000:3.0:1788587031.229038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110720768 00000100:00100000:3.0:1788587031.229043:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110720768 00000100:00100000:3.0:1788587031.229076:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110720640 00000100:00100000:3.0:1788587031.229079:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110720640 00000100:00100000:3.0:1788587031.229099:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788587031.229105:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+13:2407:x1875469110720768:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587031.229116:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587031.229135:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecda00/0xfbc93bbea5fd9b50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107b1 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.229150:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587031.229260:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+12:2407:x1875469110720768:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 154us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587031.229267:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788587031.229281:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:3.0:1788587031.229288:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+11:2407:x1875469110720640:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587031.229295:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587031.229305:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6600/0xfbc93bbea5fd9840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810699 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587031.229315:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587031.229334:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f020805-49be-45a9-ab90-7695d6719484+10:2407:x1875469110720640:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 47us (745us total) trans 0 rc 0/0 00000020:00010000:2.0:1788587031.229352:0:10387:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f5a83eb5800: total 0 00000100:00100000:3.0:1788587031.229353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00010000:00010000:2.0:1788587031.229380:0:10387:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f5a83eb5800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788587031.229448:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061099146/0xfbc93bbea5fda249 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81099b expref: 4 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.229480:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ef9d7f4/0xfbc93bbea5fda918 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b7e expref: 3 pid: 10047 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587031.229503:0:10387:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f5a83eb5800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788587031.229516:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587031.229519:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587031.229520:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587031.233840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587031.234681:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110721280 00000100:00100000:1.0:1788587031.234692:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110721280 00000100:00100000:1.0:1788587031.234783:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:1.0:1788587031.234794:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+5:2405:x1875469110721280:12345-192.168.203.1@tcp:9:umount.0 00000020:00000080:1.0:1788587031.234823:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9c1b 00000100:00080000:1.0:1788587031.234835:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5a83ce7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587031.234890:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788587031.235066:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:207b4310-f56a-4e63-b878-60fda37c3e93+2:2405:x1875469110721280:12345-192.168.203.1@tcp:9:umount.0 Request processed in 273us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.235074:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 81 00010000:00010000:2.0:1788587031.235113:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587031.244765:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.244832:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110722304 00000100:00100000:2.0:1788587031.244841:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110722304 00000100:00100000:2.0:1788587031.244902:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 258 00000100:00100000:2.0:1788587031.244913:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+22:2405:x1875469110722304:12345-192.168.203.1@tcp:39:umount.0 00000020:00000080:2.0:1788587031.244943:0:10048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd984e 00000020:00010000:2.0:1788587031.244961:0:10048:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f5bbfa67000: total 0 00000100:00080000:2.0:1788587031.244966:0:10048:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587031.245004:0:10048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788587031.245160:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:207b4310-f56a-4e63-b878-60fda37c3e93+21:2405:x1875469110722304:12345-192.168.203.1@tcp:39:umount.0 Request processed in 249us (402us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788587031.245168:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 258 00000020:00010000:1.0:1788587031.245250:0:6509:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f5bbfa67000: total 0 00010000:00010000:1.0:1788587031.245298:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f5bbfa67000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788587031.245354:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788587031.245357:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587031.245365:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71000/0xfbc93bbea5fda12a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81094e expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245381:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:1.0:1788587031.245383:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587031.245387:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b91ecd800/0xfbc93bbea5fd9b7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107bf expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245405:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587031.245407:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788587031.245411:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4e00/0xfbc93bbea5fda2ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109be expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245449:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587031.245452:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587031.245456:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f5800/0xfbc93bbea5fda8d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b69 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245467:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587031.245469:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587031.245473:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466400/0xfbc93bbea5fda903 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b77 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245484:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788587031.245487:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788587031.245490:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fd9bf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107db expref: 15 pid: 10048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245514:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f5b85f9f400) 00010000:00010000:1.0:1788587031.245517:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587031.245520:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467400/0xfbc93bbea5fda5bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810a97 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245535:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:1.0:1788587031.245538:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587031.245541:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466a00/0xfbc93bbea5fda2b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8109b7 expref: 13 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245551:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788587031.245553:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587031.245557:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a466e00/0xfbc93bbea5fda20a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810986 expref: 12 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245566:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f5a83482c00) 00010000:00010000:1.0:1788587031.245568:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788587031.245571:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa71e00/0xfbc93bbea5fda234 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810994 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245584:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f5b85f9f800) 00010000:00010000:1.0:1788587031.245586:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587031.245589:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b8a467000/0xfbc93bbea5fd9eec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8108b4 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245602:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5ba19c9800) 00010000:00010000:1.0:1788587031.245604:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587031.245612:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fd9b96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107c6 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245627:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f5bb5b3ef00) 00010000:00010000:1.0:1788587031.245629:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587031.245632:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fda7f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b31 expref: 8 pid: 13553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587031.245644:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f5bbfa67000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788587031.245657:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587031.245659:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587031.245660:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587031.256710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587031.256811:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110722432 00000100:00100000:2.0:1788587031.256821:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110722432 00000100:00100000:2.0:1788587031.256877:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 259 00000100:00100000:2.0:1788587031.256886:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+5:2405:x1875469110722432:12345-192.168.203.1@tcp:39:umount.0 00000020:00000080:2.0:1788587031.256917:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9855 00000100:00080000:2.0:1788587031.256933:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb25800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587031.256962:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788587031.257150:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:207b4310-f56a-4e63-b878-60fda37c3e93+3:2405:x1875469110722432:12345-192.168.203.1@tcp:39:umount.0 Request processed in 264us (448us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788587031.257175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 259 00010000:00010000:0.0:1788587031.257543:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587031.892611:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587031.892633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127534464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587031.892700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.892789:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587031.892802:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127534592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587031.892851:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587031.893128:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534592 00000100:00100000:1.0:1788587031.893137:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534592 00000100:00100000:1.0:1788587031.893192:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788587031.893210:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127534592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587031.893244:0:7898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788587031.893305:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127534592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587031.893314:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788587031.893632:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534464 00000100:00100000:0.0:1788587031.893638:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534464 00000100:00100000:3.0:1788587031.893688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127534592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587031.893697:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788587031.893708:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127534464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587031.893731:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788587031.893785:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127534464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.893792:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788587031.893989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127534720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587031.894409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587031.894468:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127534464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587031.894657:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534720 00000100:00100000:0.0:1788587031.894662:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534720 00000100:00100000:0.0:1788587031.894703:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788587031.894711:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127534720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587031.894724:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788587031.894767:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127534720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587031.894774:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788587031.894837:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587031.895035:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127534720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788587032.020579:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587032.824787:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587032.824828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587032.824886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587032.824919:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110722688 00000100:00100000:3.0:1788587032.824930:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110722688 00000100:00100000:3.0:1788587032.824988:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110722560 00000100:00100000:3.0:1788587032.824992:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110722560 00000100:00100000:3.0:1788587032.825004:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110722816 00000100:00100000:3.0:1788587032.825007:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110722816 00000100:00100000:3.0:1788587032.825022:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:3.0:1788587032.825031:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+12:2407:x1875469110722688:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587032.825047:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587032.825072:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030400/0xfbc93bbea5fd9958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c81071e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587032.825091:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587032.825140:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+11:2407:x1875469110722688:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 109us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.825162:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:3.0:1788587032.825214:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:3.0:1788587032.825232:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+10:2407:x1875469110722560:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587032.825250:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587032.825260:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5000/0xfbc93bbea5fd9951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106ed expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587032.825270:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587032.825288:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+9:2407:x1875469110722560:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 57us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.825294:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:3.0:1788587032.825305:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:3.0:1788587032.825311:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+8:2407:x1875469110722816:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587032.825317:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587032.825325:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2051600/0xfbc93bbea5fd9b49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8107aa expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587032.825334:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587032.825346:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f020805-49be-45a9-ab90-7695d6719484+7:2407:x1875469110722816:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.825351:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:1.0:1788587032.838121:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587032.838370:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723072 00000100:00100000:2.0:1788587032.838381:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723072 00000100:00100000:2.0:1788587032.838512:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 260 00000100:00100000:2.0:1788587032.838522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+6:2405:x1875469110723072:12345-192.168.203.1@tcp:39:umount.0 00000020:00000080:2.0:1788587032.838561:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9966 00000020:00010000:2.0:1788587032.838570:0:6520:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f5bbfb20800: total 0 00000100:00080000:2.0:1788587032.838575:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb21800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587032.838608:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788587032.838769:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2405:x1875469110723072:12345-192.168.203.1@tcp:39:umount.0 Request processed in 248us (658us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788587032.838777:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 260 00000020:00010000:3.0:1788587032.838944:0:6509:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f5bbfb20800: total 0 00010000:00010000:3.0:1788587032.838948:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587032.839000:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f5bbfb20800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788587032.839047:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83482f00) 00010000:00010000:3.0:1788587032.839051:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587032.839060:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a83c1a200/0xfbc93bbea5fda926 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b85 expref: 4 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587032.839103:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f5bbfb20800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788587032.839117:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587032.839119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587032.839121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587032.849535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587032.849635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723200 00000100:00100000:2.0:1788587032.849877:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723200 00000100:00100000:2.0:1788587032.849983:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 261 00000100:00100000:2.0:1788587032.849995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+5:2405:x1875469110723200:12345-192.168.203.1@tcp:39:umount.0 00000020:00000080:2.0:1788587032.850049:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd996d 00000100:00080000:2.0:1788587032.850072:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfb23000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587032.850106:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788587032.850309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:398d2026-4c2a-4f38-a64f-9cac397cc1c6+3:2405:x1875469110723200:12345-192.168.203.1@tcp:39:umount.0 Request processed in 308us (775us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788587032.850332:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 261 00010000:00010000:1.0:1788587032.850392:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587032.874663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587032.874759:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723456 00000100:00100000:2.0:1788587032.874770:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723456 00000100:00100000:2.0:1788587032.874831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 389 00000100:00100000:2.0:1788587032.874842:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+7:2405:x1875469110723456:12345-192.168.203.1@tcp:251:umount.0 00000020:00000080:2.0:1788587032.874889:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd982b 00000020:00010000:2.0:1788587032.874897:0:6515:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f5bbfa61800: total 0 00000100:00080000:2.0:1788587032.874901:0:6515:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa64800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788587032.874980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8f020805-49be-45a9-ab90-7695d6719484+3:2405:x1875469110723456:12345-192.168.203.1@tcp:251:umount.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587032.874987:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 389 00000020:00010000:3.0:1788587032.875678:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f5bbfa61800: total 0 00010000:00010000:3.0:1788587032.875741:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f5bbfa61800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788587032.875777:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7400/0xfbc93bbea5fd9886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c8106df expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587032.875793:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f5bbfa61800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788587032.875805:0:6510:0:(genops.c:885:class_export_put()) final put ffff8f5bbfa61800/8f020805-49be-45a9-ab90-7695d6719484 00010000:00010000:3.0:1788587032.875826:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587032.875829:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587032.875830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587032.875865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfa61800/8f020805-49be-45a9-ab90-7695d6719484 for MGS 00000020:00000080:2.0:1788587032.875907:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfa64800 for MGS 00010000:00010000:1.0:1788587033.044597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587033.428681:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587033.429918:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127534848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587033.429987:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587033.430071:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534848 00000100:00100000:1.0:1788587033.430079:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534848 00000100:00100000:1.0:1788587033.430143:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788587033.430153:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127534848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587033.430186:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788587033.430261:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127534848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587033.430268:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788587033.430360:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127534848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587033.940627:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127534976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.940701:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587033.940827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127534976 00000100:00100000:1.0:1788587033.940835:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127534976 00000100:00100000:3.0:1788587033.940892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788587033.940905:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127534976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.941615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127535104:0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.941668:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587033.941697:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587033.941702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127535232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.941721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587033.941752:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535104 00000100:00100000:1.0:1788587033.941757:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535104 00000100:00100000:0.0:1788587033.941785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127535360:0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.941790:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535232 00000100:00100000:1.0:1788587033.941794:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535232 00000100:00100000:1.0:1788587033.941817:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788587033.941825:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127535104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.941836:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b8783d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3649:x1875469127534976:12345-0@lo:400:kworker.0 Request processed in 933us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587033.941843:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788587033.941849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587033.941877:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127535104:12345-0@lo:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587033.941884:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788587033.941900:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788587033.941907:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127535232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.941917:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535360 00000100:00100000:0.0:1788587033.941923:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535360 00000100:00100000:1.0:1788587033.941939:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127535232:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587033.941943:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127534976:0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.941945:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788587033.941962:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788587033.941971:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127535360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.942006:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127535232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587033.942021:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127535104:0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.942028:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127535360:12345-0@lo:400:kworker.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587033.942035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788587033.942073:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127535360:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.943906:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127535616:0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.944064:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127535744:0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.944165:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127535872:0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.945901:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587033.945941:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127536256:0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.946074:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587033.946207:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127535488:0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.946235:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587033.946256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127536000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.946275:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587033.946343:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587033.946366:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127536384:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.946396:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535744 00000100:00100000:0.0:1788587033.946402:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587033.946405:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535744 00000100:00100000:0.0:1788587033.946453:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536256 00000100:00100000:0.0:1788587033.946463:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536256 00000100:00100000:2.0:1788587033.946489:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535872 00000100:00100000:0.0:1788587033.946492:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536384 00000100:00100000:2.0:1788587033.946494:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535872 00000100:00100000:0.0:1788587033.946497:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536384 00000100:00100000:2.0:1788587033.946527:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788587033.946537:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127535744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.946593:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127535744:12345-0@lo:400:kworker.0 Request processed in 59us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587033.946652:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587033.946662:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127536256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.946694:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127536256:12345-0@lo:400:kworker.0 Request processed in 35us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587033.946701:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587033.946717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587033.946727:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788587033.946727:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127535872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.946754:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788587033.946760:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127535872:12345-0@lo:400:kworker.0 Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587033.946765:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127536384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.946771:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788587033.946810:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127536384:12345-0@lo:400:kworker.0 Request processed in 48us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587033.946813:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127535872:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.946822:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788587033.946829:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127536384:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.946957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535488 00000100:00100000:2.0:1788587033.946961:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535488 00000100:00100000:2.0:1788587033.946990:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536000 00000100:00100000:2.0:1788587033.946993:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536000 00000100:00100000:2.0:1788587033.947015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788587033.947021:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127535488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.947052:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127535488:12345-0@lo:400:kworker.0 Request processed in 32us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587033.947057:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788587033.947069:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788587033.947074:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127536000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.947097:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127536000:12345-0@lo:400:kworker.0 Request processed in 23us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587033.947102:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:2.0:1788587033.947116:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587033.947120:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587033.947122:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587033.947146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127535744:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.947158:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127536256:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.947182:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587033.947228:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127536128:0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.947261:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127535616 00000100:00100000:0.0:1788587033.947267:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127535616 00000100:00100000:2.0:1788587033.947277:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587033.947301:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536128 00000100:00100000:0.0:1788587033.947305:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536128 00000100:00100000:2.0:1788587033.947318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788587033.947332:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587033.947342:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788587033.947351:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127536128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.947352:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127536000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587033.947375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127535488:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.947393:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127535616:12345-0@lo:400:kworker.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587033.947401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:3.0:1788587033.947408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587033.947474:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127536128:12345-0@lo:400:kworker.0 Request processed in 125us (206us total) trans 0 rc 0/0 00010000:00080000:2.0:1788587033.947477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465500 x1875469127535616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587033.947486:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788587033.947498:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127535616:0@lo:400:kworker.0 00010000:00080000:2.0:1788587033.947512:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a845ec000 x1875469127536128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587033.947520:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127536128:0@lo:400:kworker.0 00010000:00010000:2.0:1788587034.073048:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788587034.351279:0:15201:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788587034.373042:0:15201:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788587034.373121:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.373145:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.373154:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.373160:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.373180:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788587034.373205:0:15201:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788587034.373231:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587034.373236:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788587034.373241:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788587034.373264:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788587034.373461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127536512:0@lo:39:umount.0 00000100:00100000:1.0:1788587034.373526:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587034.373690:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536512 00000100:00100000:2.0:1788587034.373697:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536512 00000100:00100000:2.0:1788587034.373750:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788587034.373759:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875469127536512:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788587034.373784:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9442 00000100:00080000:2.0:1788587034.373792:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfa800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788587034.373847:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1875469127536512:12345-0@lo:39:umount.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.373853:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788587034.373861:0:6521:0:(genops.c:885:class_export_put()) final put ffff8f5bb4cfb000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788587034.373969:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587034.373975:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587034.373984:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318a200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788587034.373988:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587034.373997:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587034.374004:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587034.374009:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587034.374012:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788587034.374014:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788587034.374039:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587034.374046:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587034.374074:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587034.374096:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a200/0xfbc93bbea5fd9919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9920 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587034.374120:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587034.374122:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587034.374124:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587034.374132:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587034.374266:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127536640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587034.374299:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587034.374346:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788587034.374355:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127536512:0@lo:39:umount.0 00000100:00080000:2.0:1788587034.374439:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587034.374444:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587034.374447:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788587034.374487:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587034.374508:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536640 00000100:00100000:3.0:1788587034.374513:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536640 00000100:00100000:3.0:1788587034.374550:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587034.374557:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3648:x1875469127536640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587034.374567:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587034.374579:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fd9920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9919 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.374591:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587034.374622:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3648:x1875469127536640:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587034.374629:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:3.0:1788587034.374646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4cfb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587034.374685:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb4cfa800 for lustre-MDT0000 00000100:00100000:3.0:1788587034.374705:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127536640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587034.376294:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376311:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376319:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376326:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376367:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587034.376374:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376381:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376388:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376398:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376537:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587034.376545:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376552:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376557:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.376562:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.381002:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788587034.381029:0:15201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.381059:0:15201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.381067:0:15201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.381074:0:15201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587034.381085:0:15201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788587034.381089:0:15201:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788587034.381131:0:15201:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1788587034.381245:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788587034.381253:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381268:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318ae00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587034.381272:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381281:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587034.381287:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587034.381292:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587034.381295:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788587034.381297:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788587034.381337:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381344:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587034.381367:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381374:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318ae00/0xfbc93bbea5fd9927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd992e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381390:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587034.381394:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381400:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587034.381403:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381442:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587034.381449:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587034.381454:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587034.381456:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788587034.381459:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788587034.381473:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381479:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587034.381485:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381490:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc000/0xfbc93bbea5fd97e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd97ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381499:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587034.381503:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381509:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587034.381512:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381518:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587034.381544:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587034.381549:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587034.381552:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788587034.381553:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788587034.381566:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381572:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587034.381589:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381595:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7800/0xfbc93bbea5fd9b3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9b42 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381605:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587034.381607:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381612:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318a600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587034.381615:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381620:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587034.381625:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587034.381641:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587034.381642:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788587034.381644:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788587034.381659:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381665:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587034.381859:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381866:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a600/0xfbc93bbea5fd93a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd93a8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.381877:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587034.381879:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587034.381881:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587034.381901:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127536768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587034.381968:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587034.382019:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587034.382026:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127536896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587034.382048:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587034.382077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127537152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587034.382099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587034.382115:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587034.382120:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127537024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587034.382157:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587034.382200:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536768 00000100:00100000:0.0:1788587034.382213:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536768 00000100:00100000:0.0:1788587034.382253:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127536896 00000100:00100000:0.0:1788587034.382256:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127536896 00000100:00100000:0.0:1788587034.382270:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537152 00000100:00100000:0.0:1788587034.382272:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537152 00000100:00100000:0.0:1788587034.382284:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537024 00000100:00100000:0.0:1788587034.382286:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537024 00000100:00100000:0.0:1788587034.382300:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587034.382308:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+26:3646:x1875469127536768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587034.382321:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587034.382336:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7c00/0xfbc93bbea5fd992e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9927 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.382349:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587034.382388:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+25:3646:x1875469127536768:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.382396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587034.382439:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587034.382447:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+24:3646:x1875469127536896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587034.382454:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587034.382464:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b80030a00/0xfbc93bbea5fd97ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd97e5 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.382472:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587034.382494:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+23:3646:x1875469127536896:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.382500:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587034.382518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788587034.382536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587034.382565:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587034.382576:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad64f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+22:3649:x1875469127537024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587034.382587:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587034.382599:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2051c00/0xfbc93bbea5fd9b42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b3b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587034.382611:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587034.382757:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+21:3649:x1875469127537152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587034.382772:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587034.382783:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318a400/0xfbc93bbea5fd93a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd93a1 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587034.382793:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000000:2.0:1788587034.382853:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788587034.382865:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587034.382873:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788587034.382878:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f5bad6c9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587034.382884:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f5bbc98f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587034.382888:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f5bb5b58000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587034.382892:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f5bb5b59800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1788587034.382937:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788587034.382983:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f5bbfb20800 398d2026-4c2a-4f38-a64f-9cac397cc1c6 192.168.203.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587034.382989:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f5bbfa67000 207b4310-f56a-4e63-b878-60fda37c3e93 192.168.203.1@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1788587034.382994:0:15201:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8f5b86d50000) has exports, disconnecting them 00000020:00080000:2.0:1788587034.382998:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f5bad6c9800), last request at 1788587033 00000020:00000080:2.0:1788587034.383005:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9759 00000100:00080000:2.0:1788587034.383022:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6ce800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587034.383085:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bad6c9800): rc 0 00000020:00000080:2.0:1788587034.383088:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bad6c9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788587034.383099:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f5bbc98f000), last request at 1788587033 00000020:00000080:2.0:1788587034.383102:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9633 00000100:00080000:2.0:1788587034.383108:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc98e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587034.383118:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bbc98f000): rc 0 00000020:00000080:2.0:1788587034.383120:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bbc98f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788587034.383124:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f5bb5b58000), last request at 1788586828 00000020:00000080:2.0:1788587034.383126:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9529 00000100:00080000:2.0:1788587034.383129:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4e4b000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587034.383147:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bb5b58000): rc 0 00000020:00000080:2.0:1788587034.383149:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b58000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788587034.383153:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f5bb5b59800), last request at 1788586828 00000020:00000080:2.0:1788587034.383156:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94f1 00000100:00080000:2.0:1788587034.383160:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b68000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587034.383166:0:15201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:1.0:1788587034.383782:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788587034.384095:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bb5b59800): rc 0 00000004:00000080:2.0:1788587034.384102:0:15201:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffacde41667ae0 00000100:00080000:2.0:1788587034.384139:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587034.384143:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788587034.384376:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad64f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47977fce-e1b1-4b0c-879f-0e023b1316c2+20:3649:x1875469127537024:12345-0@lo:103:ldlm_bl.0 Request processed in 1801us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587034.384387:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587034.384513:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3649:x1875469127537152:12345-0@lo:103:ldlm_bl.0 Request processed in 1989us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587034.384521:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587034.384658:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127536896:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788587034.384762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bad6c9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587034.384807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbc98f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587034.384827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b58000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587034.384847:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bad6ce800 for lustre-MDT0000 00000020:00000080:3.0:1788587034.384850:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbc98e800 for lustre-MDT0000 00000020:00000080:3.0:1788587034.384854:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb4e4b000 for lustre-MDT0000 00000100:00100000:3.0:1788587034.384874:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127537024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587034.384882:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127537152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587034.384904:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587034.384932:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127536768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587034.385026:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587034.387136:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000001:00080000:1.0:1788587034.387151:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788587034.387157:0:6500:0:(genops.c:885:class_export_put()) final put ffff8f5bbfb20800/398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000001:00100000:1.0:1788587034.387181:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000001:00080000:1.0:1788587034.387194:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788587034.387203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfb20800/398d2026-4c2a-4f38-a64f-9cac397cc1c6 for lustre-MDT0000 00000020:00000080:1.0:1788587034.387213:0:6500:0:(genops.c:885:class_export_put()) final put ffff8f5bbfa67000/207b4310-f56a-4e63-b878-60fda37c3e93 00000100:00080000:2.0:1788587034.387315:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788587034.387342:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc989000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788587034.388914:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127537280:0@lo:39:umount.0 00000100:00100000:1.0:1788587034.389060:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788587034.389264:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfb21800 for lustre-MDT0000 00000020:00000080:3.0:1788587034.389275:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfa67000/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-MDT0000 00000020:00000080:3.0:1788587034.389400:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a822e0000 for lustre-MDT0000 00000100:00100000:2.0:1788587034.389435:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537280 00000100:00100000:2.0:1788587034.389444:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537280 00000100:00100000:2.0:1788587034.389493:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788587034.389504:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875469127537280:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788587034.389534:0:7898:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9584 00000100:00080000:2.0:1788587034.389543:0:7898:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc98e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587034.389581:0:7898:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1788587034.389593:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587034.389727:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3645:x1875469127537280:12345-0@lo:39:umount.0 Request processed in 225us (666us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788587034.389735:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788587034.389793:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc989000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788587034.389802:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127537280:0@lo:39:umount.0 00000100:00080000:2.0:1788587034.389851:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587034.389855:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788587034.389868:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788587034.389925:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788587034.389939:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc9ba800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788587034.389958:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587034.389960:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788587034.389974:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788587034.390030:0:15201:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788587034.390040:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa66800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788587034.390065:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f5b86d50000) has no exports 00000100:00100000:1.0:1788587034.391826:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127537408:0@lo:9:umount.0 00000100:00100000:1.0:1788587034.391908:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587034.391950:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127537536:0@lo:9:umount.0 00000100:00100000:1.0:1788587034.391972:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587034.392015:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537408 00000100:00100000:1.0:1788587034.392023:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537408 00000100:00100000:1.0:1788587034.392063:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537536 00000100:00100000:1.0:1788587034.392067:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537536 00000100:00100000:1.0:1788587034.392094:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587034.392104:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875469127537408:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788587034.392133:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd96d4 00000100:00080000:1.0:1788587034.392142:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5ba7eb3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587034.392205:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788587034.392297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587034.392332:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1875469127537408:12345-0@lo:9:umount.0 Request processed in 229us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.392340:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587034.392357:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587034.392366:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875469127537536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788587034.392380:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9816 00000100:00080000:0.0:1788587034.392383:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc9ba800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788587034.392386:0:8433:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bcf000 : changing import state from FULL to CLOSED 00000004:00080000:0.0:1788587034.392397:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788587034.392401:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587034.392405:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127537408:0@lo:9:umount.0 00000001:00000004:1.0:1788587034.392440:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788587034.392821:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1875469127537536:12345-0@lo:9:umount.0 Request processed in 455us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.392827:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788587034.392857:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587034.392862:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa66800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788587034.392877:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788587034.392879:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587034.392882:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127537536:0@lo:9:umount.0 00000020:00080000:2.0:1788587034.408398:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f5b86d50000) has no exports 00000020:00000080:2.0:1788587034.481218:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd93fc 00000020:00000080:2.0:1788587034.481234:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bb4cb3800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788587034.481259:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788587034.481472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4cb3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788587034.481511:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587034.481521:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788587034.481534:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8f5bb4c9cd40) has no exports 00000020:00000080:3.0:1788587034.482804:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd93f5 00000020:00000080:3.0:1788587034.482815:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788587034.482885:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587034.482895:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788587034.482898:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae7800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788587034.482901:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788587034.482906:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788587034.483089:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788587035.094618:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587035.988737:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587035.988765:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127537664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587035.988834:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587035.988949:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537664 00000100:00100000:1.0:1788587035.988970:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537664 00000100:00100000:1.0:1788587035.989035:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587035.989045:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127537664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587035.989073:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788587035.989116:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127537664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587035.989122:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788587035.989231:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127537664:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788587035.989291:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788587036.053834:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587036.116870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587037.017968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127537792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587037.018064:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587037.024164:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537792 00000100:00100000:3.0:1788587037.024187:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537792 00000001:00100000:2.0:1788587037.024243:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587037.024250:0:8429:0:(genops.c:885:class_export_put()) final put ffff8f5ba7eb1800/lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788587037.024263:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000001:00100000:2.0:1788587037.024268:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:2.0:1788587037.024272:0:8429:0:(genops.c:885:class_export_put()) final put ffff8f5a83ce7800/207b4310-f56a-4e63-b878-60fda37c3e93 00000100:00100000:3.0:1788587037.024287:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbca22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127537792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587037.024319:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788587037.024346:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788587037.024363:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7eb1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000100:00100000:3.0:1788587037.024406:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbca22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127537792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (6341us total) trans 0 rc 0/0 00000020:00000080:1.0:1788587037.024432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a83ce7800/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-OST0000 00000100:00100000:3.0:1788587037.024445:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000020:00000080:1.0:1788587037.024453:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5ba7eb3800 for lustre-OST0000 00000020:00000080:1.0:1788587037.024460:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a83ce7000 for lustre-OST0000 00000100:00100000:2.0:1788587037.024768:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127537792:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788587037.024937:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587037.024942:0:9513:0:(genops.c:885:class_export_put()) final put ffff8f5a81bcc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788587037.025174:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:3.0:1788587037.025178:0:9513:0:(genops.c:885:class_export_put()) final put ffff8f5a83eb5800/207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:2.0:1788587037.025235:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bcc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788587037.025286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a83eb5800/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-OST0001 00000020:00000080:2.0:1788587037.025306:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a81bcf000 for lustre-OST0001 00000020:00000080:2.0:1788587037.025311:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a83eb3000 for lustre-OST0001 00000001:00100000:0.0:1788587037.028472:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788587037.028486:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788587037.028492:0:7452:0:(genops.c:885:class_export_put()) final put ffff8f5bb4cb5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788587037.028556:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000001:00080000:0.0:1788587037.028563:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788587037.028566:0:7452:0:(genops.c:885:class_export_put()) final put ffff8f5bbfb26000/398d2026-4c2a-4f38-a64f-9cac397cc1c6 00000020:00000080:1.0:1788587037.033106:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4cb5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788587037.033192:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbc98e000 for lustre-MDT0001 00000001:00100000:0.0:1788587037.035472:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 207b4310-f56a-4e63-b878-60fda37c3e93 00000001:00080000:0.0:1788587037.035485:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788587037.035490:0:7452:0:(genops.c:885:class_export_put()) final put ffff8f5a822e4000/207b4310-f56a-4e63-b878-60fda37c3e93 00000020:00000080:2.0:1788587037.039365:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfb26000/398d2026-4c2a-4f38-a64f-9cac397cc1c6 for lustre-MDT0001 00000020:00000080:2.0:1788587037.039457:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfb23000 for lustre-MDT0001 00000020:00000080:1.0:1788587037.039858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a822e4000/207b4310-f56a-4e63-b878-60fda37c3e93 for lustre-MDT0001 00000020:00000080:1.0:1788587037.039893:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfb25800 for lustre-MDT0001 00010000:00010000:1.0:1788587037.140739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587038.164717:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587038.548663:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587038.550885:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127537920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587038.550967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587038.553399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127537920 00000100:00100000:0.0:1788587038.553443:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127537920 00000100:00100000:0.0:1788587038.553500:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788587038.553516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875469127537920:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788587038.553527:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788587038.553623:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875469127537920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (2656us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587038.553634:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:02020000:1.0:1788587038.555797:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788587038.565328:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587038.565336:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cb6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788587038.565340:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788587038.588087:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cb6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587038.588103:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 174 00000100:00080000:1.0:1788587038.588130:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f5bb4cb6800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587038.588178:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e34380 x1875469127538048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587038.589988:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127538048:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788587038.590075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587038.590206:0:7898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538048 00000100:00100000:0.0:1788587038.590215:0:7898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538048 00000100:00100000:0.0:1788587038.590257:0:7898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788587038.590264:0:7898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875469127538048:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788587038.590281:0:7898:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788587038.598908:0:7898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875469127538048:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 8634us (8825us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587038.598924:0:7898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1788587038.599044:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cb6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587038.599050:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587038.599065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127538048:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788587039.060637:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587039.062455:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127538432:0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.062523:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587039.062586:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587039.062604:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127538304:0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.062636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587039.062671:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538432 00000100:00100000:3.0:1788587039.062677:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538432 00000100:00100000:3.0:1788587039.062736:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538304 00000100:00100000:3.0:1788587039.062740:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538304 00000100:00100000:3.0:1788587039.062761:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788587039.062767:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875469127538432:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788587039.062775:0:10048:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788587039.062811:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875469127538432:12345-0@lo:400:kworker.0 Request processed in 43us (288us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587039.062818:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788587039.062833:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788587039.062837:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875469127538304:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788587039.062857:0:10048:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788587039.062879:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875469127538304:12345-0@lo:400:kworker.0 Request processed in 41us (243us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587039.062884:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788587039.062917:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587039.062922:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b5d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788587039.062925:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788587039.062930:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b5d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587039.062933:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 174 00000100:00080000:3.0:1788587039.062940:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f5bb5b5d000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587039.062959:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83108380 x1875469127538688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587039.062981:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127538304:0@lo:400:kworker.0 00000100:00080000:3.0:1788587039.062993:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587039.062996:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788587039.062998:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788587039.063007:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587039.063010:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 193 00000100:00080000:3.0:1788587039.063014:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f5a822e2000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587039.063028:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a8310ad80 x1875469127538816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587039.063039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127538432:0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.063063:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127538688:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788587039.063088:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587039.063104:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127538816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788587039.063122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587039.063145:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538688 00000100:00100000:3.0:1788587039.063149:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538688 00000100:00100000:3.0:1788587039.063176:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538816 00000100:00100000:3.0:1788587039.063179:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538816 00000100:00100000:3.0:1788587039.063188:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788587039.063192:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875469127538688:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788587039.063206:0:10048:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788587039.063235:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875469127538688:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 42us (147us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587039.063241:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788587039.063252:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788587039.063256:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875469127538816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788587039.063263:0:10048:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788587039.063287:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875469127538816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 30us (164us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587039.063301:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788587039.063327:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b5d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587039.063331:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587039.063334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127538688:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788587039.063341:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587039.063343:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587039.063346:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127538816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788587039.065033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127538560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587039.065176:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587039.065365:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127538176:0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.065889:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538560 00000100:00100000:3.0:1788587039.065898:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538560 00000100:00100000:3.0:1788587039.065964:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788587039.065975:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127538560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788587039.066005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587039.066275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127539072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587039.066404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127538944:0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.069500:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127538560:12345-0@lo:400:kworker.0 Request processed in 3519us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587039.069515:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788587039.069567:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127539200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.069609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587039.070276:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539200 00000100:00100000:3.0:1788587039.070286:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539200 00000100:00100000:3.0:1788587039.070344:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788587039.070352:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127539200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.070407:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127539200:12345-0@lo:400:kworker.0 Request processed in 56us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587039.070413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:3.0:1788587039.070450:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788587039.070478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a845ef100 x1875469127539200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587039.070504:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127539200:0@lo:400:kworker.0 00000100:00100000:0.0:1788587039.072526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587039.072901:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538176 00000100:00100000:3.0:1788587039.072910:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538176 00000100:00100000:3.0:1788587039.072957:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788587039.072966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3648:x1875469127538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.073123:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b87839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47977fce-e1b1-4b0c-879f-0e023b1316c2+19:3648:x1875469127538176:12345-0@lo:400:kworker.0 Request processed in 142us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587039.073131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788587039.073144:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127539328:0@lo:400:kworker.0 00000100:00100000:0.0:1788587039.073197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788587039.073378:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a845efb80 x1875469127538560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587039.073585:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539328 00000100:00100000:3.0:1788587039.073590:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539328 00000100:00100000:3.0:1788587039.073659:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788587039.073667:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587039.073707:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127539328:12345-0@lo:400:kworker.0 Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587039.073714:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788587039.073731:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587039.073853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127538560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587039.073872:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127538176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587039.073902:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127539328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587039.079824:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587039.081190:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587039.081308:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127538944 00000100:00100000:2.0:1788587039.081318:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127538944 00000100:00080000:3.0:1788587039.081376:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587039.081383:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788587039.081394:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127538944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587039.081478:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127538944:12345-0@lo:400:kworker.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587039.081503:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788587039.081504:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127538944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587039.081585:0:13553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539072 00000100:00100000:0.0:1788587039.081595:0:13553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539072 00000100:00100000:0.0:1788587039.081635:0:13553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788587039.081641:0:13553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1875469127539072:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788587039.081646:0:13553:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788587039.081687:0:13553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1875469127539072:12345-0@lo:400:kworker.0 Request processed in 46us (1871us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587039.081693:0:13553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788587039.081860:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788587039.081865:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788587039.081869:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788587039.099695:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587039.099709:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 213 00000100:00080000:2.0:1788587039.099718:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f5a83355000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587039.099786:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83e81880 x1875469127539456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587039.099824:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127539072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587039.099938:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127539456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788587039.100006:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587039.102885:0:10048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539456 00000100:00100000:2.0:1788587039.102898:0:10048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539456 00000100:00100000:2.0:1788587039.102955:0:10048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788587039.102963:0:10048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875469127539456:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788587039.102982:0:10048:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788587039.113886:0:10048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875469127539456:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 10914us (13871us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587039.113900:0:10048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788587039.114149:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587039.114164:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587039.114169:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127539456:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1788587039.188774:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587040.101273:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587040.101282:0:6500:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b59800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587040.101386:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b59800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788587040.101532:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb5b68000 for lustre-MDT0000 00010000:00010000:1.0:1788587040.217441:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788587040.532620:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5a8277e5a0 - data ffff8f5bb12fc0d8/ffff8f5bbcbfc800 00000020:01000000:2.0:1788587040.532783:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5bb4d55ba0 - data ffff8f5bb1185ca8/ffff8f5bb4e5f400 00000001:00000004:2.0:1788587040.542829:0:15201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788587040.608183:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788587040.608192:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788587040.608206:0:15201:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f5a845ef800 x1875469127537280/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788587044 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587040.608233:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788587040.611221:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587040.611228:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788587040.611352:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587040.611355:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587040.622226:0:8743:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587040.622236:0:8743:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788587040.622248:0:8743:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788587040.633872:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788587040.633879:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788587040.633943:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587040.633946:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587040.643957:0:10053:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587040.643964:0:10053:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788587040.643978:0:10053:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788587040.653624:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd93c4 00000020:00000080:3.0:1788587040.653638:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5b88519800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788587040.654184:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b88519800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788587040.660313:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd93d9 00000020:00000080:3.0:1788587040.660328:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788587040.660358:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788587040.660364:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587040.660373:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587040.660377:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8f5ba7ab19c0) has no exports 00000004:01000000:3.0:1788587040.660582:0:15201:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788587040.660592:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd980f 00000020:00000080:3.0:1788587040.660596:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bbfa67800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788587040.660601:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788587040.660604:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587040.660613:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587040.660615:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8f5a826ecd40) has no exports 00000020:00000080:3.0:1788587040.660621:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9808 00000020:00000080:3.0:1788587040.660626:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bbfa65000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788587040.660782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788587040.660796:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfa67800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788587040.660803:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfa65000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788587040.660970:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788587040.660975:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587040.660979:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788587040.660985:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587040.660988:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587040.661221:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.661230:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587040.661236:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd96cd 00000020:00000080:3.0:1788587040.661240:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5a81bf6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788587040.661244:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788587040.661248:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587040.661252:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587040.661254:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8f5a826eb380) has no exports 00000020:00000080:3.0:1788587040.661269:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd96c6 00000020:00000080:3.0:1788587040.661271:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bbdb94800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788587040.661687:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788587040.661691:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587040.661693:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788587040.661697:0:15201:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587040.661699:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587040.661721:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.661727:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788587040.661737:0:15201:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788587040.661742:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd957d 00000020:00000080:3.0:1788587040.661747:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bb4e48800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788587040.661750:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788587040.661753:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587040.661757:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587040.661760:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8f5bb05e19c0) has no exports 00000020:00000080:3.0:1788587040.661763:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9576 00000020:00000080:3.0:1788587040.661766:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bbc98c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788587040.665397:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbfa66800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788587040.665423:0:37:0:(genops.c:885:class_export_put()) final put ffff8f5bbfa62800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788587040.665427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbfa62800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788587040.665434:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587040.665534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bf6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788587040.665540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbdb94800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788587040.665546:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbc9ba800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788587040.665550:0:37:0:(genops.c:885:class_export_put()) final put ffff8f5a81bc9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788587040.665551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bc9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788587040.665555:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587040.665576:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4e48800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788587040.665582:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbc98c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788587040.806922:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788587040.806934:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788587040.806940:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788587040.806950:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587040.807020:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.807038:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587040.807065:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bbc989000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788587040.807069:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.807075:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587040.807077:0:37:0:(genops.c:885:class_export_put()) final put ffff8f5bbc988800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587040.807079:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5b88518000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788587040.807082:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbc988800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788587040.807084:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b88518000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788587040.807099:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788587040.807099:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587040.807248:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd93e0 00000020:00000080:3.0:1788587040.807267:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae1800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788587040.807292:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788587040.807296:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587040.807300:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587040.807304:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8f5b86d519c0) has no exports 00000020:00000080:3.0:1788587040.807327:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.807330:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788587040.807334:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd93e7 00000020:00000080:3.0:1788587040.807338:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae5800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788587040.807346:0:15201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5b86e73000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788587040.807349:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5b86e73000 3 00000020:01000004:3.0:1788587040.807352:0:15201:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f5b86e73000 from lustre-MDT0000 00000020:00000080:3.0:1788587040.807368:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.807371:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788587040.807374:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5baaa5a000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788587040.807376:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5baaa5a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788587040.807384:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788587040.807440:0:15201:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788587040.807445:0:15201:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788587040.807448:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788587040.807451:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587040.807454:0:15201:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587040.807461:0:15201:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8f5bad5fc800 47977fce-e1b1-4b0c-879f-0e023b1316c2 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587040.807466:0:15201:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8f5bb05e4d40) has exports, disconnecting them 00000020:00080000:3.0:1788587040.807470:0:15201:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f5bad5fc800), last request at 1788586808 00000020:00000080:3.0:1788587040.807482:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9385 00000020:00010000:3.0:1788587040.807486:0:15201:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f5bad5fc800: total 2 00000100:00080000:3.0:1788587040.807489:0:15201:0:(import.c:65:import_set_state_nolock()) ffff8f5bad5fb800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788587040.807507:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bad5fc800): rc 0 00000020:00080000:3.0:1788587040.807511:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8f5bb05e4d40) has no exports 00000020:00010000:1.0:1788587040.807532:0:10387:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f5bad5fc800: total 2 00010000:00010000:1.0:1788587040.807574:0:10387:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f5bad5fc800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788587040.807605:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecc800/0xfbc93bbea5fd9904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd98fd expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807635:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7000/0xfbc93bbea5fd97a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd979f expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807650:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6c00/0xfbc93bbea5fd98a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd989b expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807661:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fd98b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd98a9 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807672:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7200/0xfbc93bbea5fd9481 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd947a expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807683:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318b200/0xfbc93bbea5fd98da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd98d3 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807694:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318b800/0xfbc93bbea5fd948f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9488 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807705:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa7600/0xfbc93bbea5fd9b18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b11 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807715:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6800/0xfbc93bbea5fd9b26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b1f expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807724:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318ba00/0xfbc93bbea5fd98cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd98c5 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807733:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8318be00/0xfbc93bbea5fd994a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9943 expref: 4 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807756:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5ba1aa6400/0xfbc93bbea5fd9b34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd9b2d expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807768:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b91ecd200/0xfbc93bbea5fd98f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xfbc93bbea5fd98ef expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587040.807778:0:10387:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f5bad5fc800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788587040.807793:0:10387:0:(genops.c:885:class_export_put()) final put ffff8f5bad5fc800/47977fce-e1b1-4b0c-879f-0e023b1316c2 00010000:00010000:1.0:1788587040.807799:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587040.807802:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587040.807803:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587040.807866:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f5bb0619a00:6514] 0 exiting: rc = 1 00000100:00100000:1.0:1788587040.807977:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f5b9133c400:6516] 2 exiting: rc = 0 00000020:00000080:0.0:1788587040.808769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788587040.808776:0:37:0:(genops.c:885:class_export_put()) final put ffff8f5baaa5c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788587040.808779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5baaa5c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788587040.808784:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788587040.808838:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788587040.808842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bad5fc800/47977fce-e1b1-4b0c-879f-0e023b1316c2 for MGS 00000020:00000080:0.0:1788587040.808983:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bad5fb800 for MGS 00000100:00100000:3.0:1788587040.808988:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f5b855cda00:6515] 1 exiting: rc = 0 00000100:00100000:1.0:1788587040.809049:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809060:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809068:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809074:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809080:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809086:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809092:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809098:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809103:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809108:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809113:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809118:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809123:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809129:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809135:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809149:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809156:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809162:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809177:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809182:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809187:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809193:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809197:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809204:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809209:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809214:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809220:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809224:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809230:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809236:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809242:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809247:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809252:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809257:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809262:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809267:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809274:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809280:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809286:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809290:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809296:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809301:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809307:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809313:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809317:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809323:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809328:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809333:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809339:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809344:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809350:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809355:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809360:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809373:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809379:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809384:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809389:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809394:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809399:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809405:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809410:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809446:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809518:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587040.809528:0:15201:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788587040.810312:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5a8277e360 - data ffff8f5bb11f3d80/ffff8f5bbcacac00 00000020:01000000:1.0:1788587040.810542:0:15201:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5b9a6ca660 - data ffff8f5bb10b0360/ffff8f5ba05ebc00 00000020:00000080:1.0:1788587040.810969:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9369 00000020:00000080:1.0:1788587040.810977:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5b8a133000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788587040.810992:0:15201:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5b86e73000 from MGS, refs=2 00000020:01000004:1.0:1788587040.810995:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5b86e73000 2 00000020:01000004:1.0:1788587040.810998:0:15201:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f5b86e73000 from MGS 00000020:00000080:1.0:1788587040.811018:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587040.811025:0:15201:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788587040.811027:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5b8a4c8800/MGS 00000020:00000080:1.0:1788587040.811029:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b8a4c8800/MGS for MGS 00000020:01000000:1.0:1788587040.811036:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788587040.811096:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788587040.811100:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587040.811105:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587040.811111:0:15201:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f5bb4cff800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587040.811117:0:15201:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8f5bb05e0000) has exports, disconnecting them 00000020:00080000:1.0:1788587040.811121:0:15201:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f5bb4cff800), last request at 1788586809 00000020:00000080:1.0:1788587040.811125:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9434 00000020:00080000:1.0:1788587040.811135:0:15201:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bb4cff800): rc 0 00000020:00000080:1.0:1788587040.811139:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5bb4cff800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788587040.811801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b8a133000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788587040.811809:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4cff800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788587040.812532:0:15201:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788587040.812537:0:15201:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587040.812542:0:15201:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587040.812548:0:15201:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587040.812744:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587040.812752:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788587040.812758:0:15201:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5b86e73000 1 00000020:00000080:0.0:1788587040.812762:0:15201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd935b 00000020:00000080:0.0:1788587040.812769:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5b8a4ca000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788587040.812868:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb4cfd800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788587040.812876:0:37:0:(genops.c:885:class_export_put()) final put ffff8f5b86b7f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788587040.812886:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b86b7f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788587040.812891:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788587040.813000:0:15201:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788587040.813005:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587040.813008:0:15201:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587040.813012:0:15201:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8f5b86d54d40) has no exports 00000020:00000080:3.0:1788587040.813208:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b8a4ca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788587040.956171:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587040.956185:0:15201:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788587040.956192:0:15201:0:(genops.c:885:class_export_put()) final put ffff8f5b86e71800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788587040.956196:0:15201:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b86e71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788587040.956202:0:15201:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788587040.956312:0:15201:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f5b86e77800 00000020:02000400:3.0:1788587040.956384:0:15201:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788587041.109517:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127539584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587041.109586:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587041.109652:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539584 00000100:00100000:3.0:1788587041.109660:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539584 00000100:00100000:3.0:1788587041.109710:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788587041.109719:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127539584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587041.109749:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788587041.109790:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127539584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587041.109798:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788587041.109818:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587041.109851:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127539584:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788587041.236641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587042.132777:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587042.132799:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127539712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587042.132883:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587042.132958:0:13446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539712 00000100:00100000:0.0:1788587042.132966:0:13446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539712 00000100:00100000:0.0:1788587042.133031:0:13446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788587042.133041:0:13446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127539712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587042.133069:0:13446:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788587042.133112:0:13446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127539712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587042.133119:0:13446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788587042.133188:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127539712:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788587042.133357:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788587042.263394:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587043.288831:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587044.180667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587044.180676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788587044.180681:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cb6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587044.180691:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1788587044.180698:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587044.180706:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f5bb4cb6800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587044.180731:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83e80e00 x1875469127539968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587044.180748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587044.180752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788587044.180754:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b5d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587044.180757:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1788587044.180760:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587044.180763:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f5bb5b5d000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587044.180774:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83e80a80 x1875469127540096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587044.180782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587044.180785:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788587044.180786:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587044.180789:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1788587044.180791:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587044.180795:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f5a822e2000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587044.180803:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83e81c00 x1875469127540224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587044.180840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587044.180857:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788587044.180859:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587044.180863:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 385 00000100:00080000:2.0:1788587044.180865:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587044.180869:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f5a83355000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587044.180881:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83e83100 x1875469127540608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587044.180927:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127540352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.180994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587044.181053:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587044.181060:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127540480:0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.181086:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587044.181138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540352 00000100:00100000:2.0:1788587044.181146:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540352 00000100:00100000:2.0:1788587044.181199:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788587044.181205:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127539840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.181209:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127540352:12345-0@lo:400:kworker.0 00000400:00000100:0.0:1788587044.181240:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469127539840 offset 0 length 224: 4 00000100:00100000:2.0:1788587044.181256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127540352:12345-0@lo:400:kworker.0 Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587044.181260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127540864:0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.181264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788587044.181281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587044.181301:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587044.181306:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127540736:0@lo:400:kworker.0 00000100:00100000:0.0:1788587044.181326:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587044.181340:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127539968:0@lo:38:kworker.0 00000100:00100000:1.0:1788587044.181371:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587044.181391:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127540096:0@lo:38:kworker.0 00000100:00100000:1.0:1788587044.181440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587044.181463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127540224:0@lo:38:kworker.0 00000100:00100000:1.0:1788587044.181484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587044.181501:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127540608:0@lo:38:kworker.0 00000100:00100000:1.0:1788587044.181521:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587044.181560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540736 00000100:00100000:1.0:1788587044.181563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540736 00000100:00100000:1.0:1788587044.181588:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540096 00000100:00100000:1.0:1788587044.181591:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540096 00000100:00100000:1.0:1788587044.181600:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540224 00000100:00100000:1.0:1788587044.181602:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540224 00000100:00100000:1.0:1788587044.181611:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540608 00000100:00100000:1.0:1788587044.181613:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540608 00000100:00100000:1.0:1788587044.181622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788587044.181629:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127540736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587044.181668:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127540736:12345-0@lo:400:kworker.0 Request processed in 40us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587044.181675:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788587044.181690:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788587044.181694:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127540096:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788587044.181713:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587044.181746:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127540096:12345-0@lo:38:kworker.0 Request processed in 49us (331us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587044.181762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788587044.181776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788587044.181780:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127540224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788587044.181789:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587044.181819:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127540224:12345-0@lo:38:kworker.0 Request processed in 38us (334us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587044.181824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788587044.181834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788587044.181837:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127540608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788587044.181845:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587044.181868:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875469127540608:12345-0@lo:38:kworker.0 Request processed in 29us (346us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587044.181874:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788587044.181890:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127539968 00000100:00100000:1.0:1788587044.181894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127539968 00000100:00100000:1.0:1788587044.181911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788587044.181916:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875469127539968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788587044.181925:0:6526:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587044.181949:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875469127539968:12345-0@lo:38:kworker.0 Request processed in 32us (578us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587044.181955:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:1.0:1788587044.181999:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f5a84523800 x1875469127540736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587044.182013:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127540736:0@lo:400:kworker.0 00000100:00080000:1.0:1788587044.182058:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cb6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587044.182064:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587044.182067:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127539968:0@lo:38:kworker.0 00000100:00080000:1.0:1788587044.182077:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b5d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587044.182080:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587044.182083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127540096:0@lo:38:kworker.0 00000100:00080000:1.0:1788587044.182091:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587044.182094:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587044.182097:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127540224:0@lo:38:kworker.0 00000100:00080000:1.0:1788587044.182103:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587044.182106:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587044.182109:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127540608:0@lo:38:kworker.0 00000100:00080000:3.0:1788587044.184536:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788587044.184598:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f5a83e82d80 x1875469127540352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587044.184615:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127540352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.186665:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540480 00000100:00100000:2.0:1788587044.186678:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540480 00000100:00100000:2.0:1788587044.186764:0:10047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540864 00000100:00100000:2.0:1788587044.186768:0:10047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540864 00000100:00100000:2.0:1788587044.186796:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587044.186806:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127540480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.186889:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127540480:12345-0@lo:400:kworker.0 Request processed in 85us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587044.186908:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788587044.186928:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587044.186936:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127540864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587044.186943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127540480:0@lo:400:kworker.0 00000100:00100000:2.0:1788587044.186985:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127540864:12345-0@lo:400:kworker.0 Request processed in 50us (5702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587044.186993:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788587044.187034:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127540864:0@lo:400:kworker.0 00000100:00080000:1.0:1788587044.187138:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587044.187142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1788587044.306891:0:15404:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:0.0:1788587044.315269:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587044.318696:0:15404:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788587044.318749:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318765:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318773:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318781:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318808:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587044.318814:0:15404:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788587044.318842:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587044.318848:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318854:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788587044.318858:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318867:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587044.318874:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587044.318880:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587044.318882:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788587044.318885:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788587044.318919:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318926:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587044.318954:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318961:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6200/0xfbc93bbea5fd98ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd98f6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.318973:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587044.318980:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587044.318982:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587044.318997:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587044.319001:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587044.319007:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587044.319013:0:15404:0:(import.c:65:import_set_state_nolock()) ffff8f5bb5b5d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788587044.319017:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587044.319019:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587044.319022:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788587044.319709:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587044.319730:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127540992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587044.319797:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587044.319863:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127540992 00000100:00100000:2.0:1788587044.319870:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127540992 00000100:00100000:2.0:1788587044.319910:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587044.319917:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875469127540992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788587044.319924:0:8450:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587044 with bad export cookie 18143098263853437829 00010000:00010000:1.0:1788587044.323870:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323889:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323897:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323905:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323935:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587044.323942:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323950:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323957:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323980:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.323996:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587044.324002:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324009:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324016:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324022:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324033:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788587044.324044:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587044.324050:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324057:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6a00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788587044.324061:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324070:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587044.324078:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587044.324093:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587044.324095:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788587044.324139:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324146:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587044.324169:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324178:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa6a00/0xfbc93bbea5fd98fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9904 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324193:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587044.324196:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324202:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788587044.324204:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324211:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587044.324218:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587044.324224:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587044.324226:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788587044.324228:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788587044.324249:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324256:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587044.324271:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324278:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80030600/0xfbc93bbea5fd979f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd97a6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324291:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587044.324295:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324301:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788587044.324304:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324311:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587044.324317:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587044.324323:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788587044.324325:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788587044.324327:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788587044.324337:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324343:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587044.324349:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324361:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bc2051800/0xfbc93bbea5fd9b2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd9b34 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587044.324371:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587044.324373:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587044.324375:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587044.324392:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127541248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587044.324478:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587044.325316:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127541248 00000100:00100000:0.0:1788587044.325325:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127541248 00000100:00100000:0.0:1788587044.325451:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587044.325459:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875469127541248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788587044.325465:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587044 with bad export cookie 18143098263853437829 00000100:00100000:0.0:1788587044.325517:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1875469127541248:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1039us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587044.325595:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788587044.325628:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587044.326176:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587044.326185:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587044.326200:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127541120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587044.326247:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587044.326315:0:15404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.326326:0:15404:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.326333:0:15404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.326339:0:15404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.326354:0:15404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587044.326399:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127541120 00000100:00100000:3.0:1788587044.326409:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127541120 00000100:00100000:3.0:1788587044.326453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587044.326458:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875469127541120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788587044.326463:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587044 with bad export cookie 18143098263853437829 00000100:00080000:1.0:1788587044.326475:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587044.326480:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788587044.326483:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788587044.326497:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875469127541120:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (250us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587044.326508:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788587044.326538:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 10000000:01000000:0.0:1788587044.327277:0:15404:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788587044.327284:0:15404:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788587044.327317:0:15404:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788587044.327321:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788587044.327326:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587044.327331:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788587044.327336:0:15404:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f5bad6cc800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587044.327342:0:15404:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f5a822e3800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587044.327346:0:15404:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8f5bae570000) has exports, disconnecting them 00000020:00080000:0.0:1788587044.327350:0:15404:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f5bad6cc800), last request at 1788587044 00000020:00000080:0.0:1788587044.327356:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9767 00000100:00080000:0.0:1788587044.327634:0:15404:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6cf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788587044.327681:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587044.327688:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.327713:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91eccc00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587044.327716:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.327725:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587044.327731:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587044.327735:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587044.327737:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788587044.327740:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1788587044.347981:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.101@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788587044.347987:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788587044.347998:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5a83e80000 x1875469127539840/t0(0) o400->MGC192.168.203.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788587060 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587044.348013:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5bb4e37b80 x1875469127540992/t0(0) o103->MGC192.168.203.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587060 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587044.348023:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5bb4e35880 x1875469127541248/t0(0) o103->MGC192.168.203.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587060 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587044.348032:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5bb4e36d80 x1875469127541120/t0(0) o103->MGC192.168.203.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587060 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587044.348796:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f5bb069c000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788587044.348819:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47977fce-e1b1-4b0c-879f-0e023b1316c2:3648:1875469127541120:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788587044.348954:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788587044.348957:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788587044.348959:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788587044.348962:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587044.348967:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.203.101@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:1.0:1788587044.348975:0:3646:0:(import.c:665:import_select_connection()) MGC192.168.203.101@tcp: import ffff8f5bb069c000 using connection 192.168.203.101@tcp/0@lo 00010000:00010000:1.0:1788587044.349002:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587044.349031:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e36d80 x1875469127541504/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587044.349066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127541504:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788587044.349108:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469127541504 offset 0 length 520: 4 00000100:00100000:1.0:1788587044.349159:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47977fce-e1b1-4b0c-879f-0e023b1316c2:3646:1875469127541248:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788587044.349198:0:15404:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bad6cc800): rc 0 00000020:00000080:1.0:1788587044.349201:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bad6cc800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788587044.349216:0:15404:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f5a822e3800), last request at 1788587044 00000020:00000080:1.0:1788587044.349223:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9641 00010000:00010000:0.0:1788587044.349339:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.349349:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587044.349367:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.349376:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91eccc00/0xfbc93bbea5fd9488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xfbc93bbea5fd948f expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587044.349394:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587044.349396:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587044.349398:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587044.349647:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:3649:1875469127540992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587044.349660:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587044.349667:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47977fce-e1b1-4b0c-879f-0e023b1316c2:0:1875469127541632:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788587044.349969:0:15404:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788587044.349985:0:15404:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5a822e3800): rc 0 00000020:00000080:1.0:1788587044.349987:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5a822e3800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788587044.349996:0:15404:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffacde4156fae0 00000100:00080000:1.0:1788587044.350013:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587044.350020:0:15404:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8f5a83109f80 x1875469127537920/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788587054 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587044.350031:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788587044.350352:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788587044.350393:0:8450:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875469127540992 offset 224 length 224: 4 00000100:00100000:0.0:1788587044.350410:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875469127540992:12345-0@lo:103:ldlm_bl.0 Request processed in 30492us (30614us total) trans 0 rc -107/-107 00000100:00080000:1.0:1788587044.351307:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587044.351314:0:15404:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cb6800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1788587044.351397:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127537920:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788587044.351516:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bad6cc800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788587044.351556:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a822e3800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788587044.351576:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bad6cf800 for lustre-MDT0001 00000020:00000080:1.0:1788587044.351581:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a822e5000 for lustre-MDT0001 00000100:00100000:0.0:1788587044.351655:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788587044.351995:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788587044.352000:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788587044.352016:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587044.352069:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788587044.352088:0:15404:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bf2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788587044.352111:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788587044.352113:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788587044.352128:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587044.352189:0:15404:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788587044.352198:0:15404:0:(import.c:65:import_set_state_nolock()) ffff8f5a8227f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788587044.352220:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f5bae570000) has no exports 00000100:00100000:3.0:1788587044.352457:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127541760:0@lo:9:umount.0 00000100:00100000:3.0:1788587044.352517:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587044.352551:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127541888:0@lo:9:umount.0 00000100:00100000:3.0:1788587044.352570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587044.352605:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127541760 00000100:00100000:3.0:1788587044.352612:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127541760 00000100:00100000:3.0:1788587044.352647:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127541888 00000100:00100000:3.0:1788587044.352650:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127541888 00000100:00100000:3.0:1788587044.352670:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587044.352688:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875469127541760:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587044.352725:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9695 00000100:00080000:3.0:1788587044.352733:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bcc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587044.352773:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788587044.352974:0:10047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587044.352984:0:10047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875469127541888:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788587044.352997:0:10047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd97d0 00000100:00080000:0.0:1788587044.353003:0:10047:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bc9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587044.353030:0:10047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788587044.353098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:0:1875469127541376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587044.353136:0:10047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3645:x1875469127541888:12345-0@lo:9:umount.0 Request processed in 153us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587044.353144:0:10047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788587044.353189:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a8227f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788587044.353201:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788587044.353203:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587044.353207:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127541888:0@lo:9:umount.0 00010000:00010000:0.0:1788587044.353247:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587044.353291:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47977fce-e1b1-4b0c-879f-0e023b1316c2:3647:1875469127539840:0@lo:400:kworker.0 00010000:00010000:2.0:1788587044.353335:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587044.355022:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875469127541760:12345-0@lo:9:umount.0 Request processed in 2328us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587044.355036:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788587044.355054:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a81bf2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788587044.355068:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788587044.355071:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587044.355074:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127541760:0@lo:9:umount.0 00000020:00080000:1.0:1788587044.362828:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f5bae570000) has no exports 00000020:01000000:0.0:1788587044.432101:0:15404:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5a8277ed80 - data ffff8f5bb12fe360/ffff8f5bbcbfd800 00000020:01000000:0.0:1788587044.432277:0:15404:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5bbc8b66c0 - data ffff8f5bb11ce510/ffff8f5bbc986800 00000001:00000004:0.0:1788587044.444314:0:15404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788587044.499799:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587044.499808:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788587044.499816:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788587044.506152:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587044.506169:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788587044.506195:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587044.506198:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587044.509932:0:8739:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587044.509941:0:8739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788587044.509955:0:8739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788587044.510865:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587044.510871:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788587044.510890:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587044.510894:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587044.511316:0:10044:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587044.511320:0:10044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788587044.511328:0:10044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788587044.512463:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94ab 00000020:00000080:3.0:1788587044.512472:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bae587800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788587044.512546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae587800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788587044.514904:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94c0 00000020:00000080:3.0:1788587044.514916:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bae582000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587044.514936:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788587044.514942:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587044.514950:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587044.514954:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8f5bae573380) has no exports 00000020:00000080:0.0:1788587044.514993:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae582000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788587044.515113:0:15404:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788587044.515132:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd97c9 00000020:00000080:3.0:1788587044.515136:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5a81bce000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587044.515150:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788587044.515154:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587044.515161:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587044.515163:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8f5a826e99c0) has no exports 00000020:00000080:3.0:1788587044.515169:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd97c2 00000020:00000080:0.0:1788587044.515172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bce000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788587044.515181:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5a8227c000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788587044.515196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a8227c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788587044.515820:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788587044.515825:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587044.515829:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788587044.515835:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587044.515837:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587044.515880:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587044.515888:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587044.515894:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9687 00000020:00000080:3.0:1788587044.515900:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5a81bce800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587044.515904:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788587044.515908:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587044.515912:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587044.515914:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8f5baf190000) has no exports 00000020:00000080:3.0:1788587044.515918:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9680 00000020:00000080:3.0:1788587044.515921:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bbdb94000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788587044.516266:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788587044.516270:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587044.516272:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788587044.516276:0:15404:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587044.516277:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587044.516300:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587044.516306:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788587044.516315:0:15404:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788587044.516320:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94e3 00000020:00000080:3.0:1788587044.516326:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b5e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587044.516330:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788587044.516334:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587044.516337:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587044.516340:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8f5ba7ab4d40) has no exports 00000020:00000080:3.0:1788587044.516519:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94dc 00000020:00000080:3.0:1788587044.516523:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bb4cb2800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788587044.517848:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a8227f800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788587044.517861:0:36:0:(genops.c:885:class_export_put()) final put ffff8f5bad6ce000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788587044.517864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bad6ce000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788587044.517872:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587044.517957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bce800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788587044.517962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbdb94000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788587044.517967:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a81bf2000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788587044.517970:0:36:0:(genops.c:885:class_export_put()) final put ffff8f5bbdb91000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788587044.517972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbdb91000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788587044.517975:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587044.518014:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b5e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788587044.518020:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4cb2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788587044.525102:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788587044.525111:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587044.525126:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788587044.525136:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587044.525197:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587044.525209:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587044.525255:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587044.525260:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587044.525266:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5b853d5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788587044.525270:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b853d5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788587044.525277:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587044.525482:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94c7 00000020:00000080:0.0:1788587044.525490:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bae580800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788587044.525494:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788587044.525498:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587044.525513:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587044.525516:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8f5bae5719c0) has no exports 00000020:00000080:0.0:1788587044.525533:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587044.525536:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788587044.525540:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd94ce 00000020:00000080:0.0:1788587044.525544:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bae586000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788587044.525550:0:15404:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5baaa5e000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788587044.525554:0:15404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5baaa5e000 2 00000020:01000004:0.0:1788587044.525557:0:15404:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f5baaa5e000 from lustre-MDT0001 00000020:00000080:0.0:1788587044.525573:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587044.525576:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788587044.525589:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bae582800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788587044.525591:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae582800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788587044.525599:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788587044.525628:0:15404:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788587044.525632:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788587044.525635:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587044.525638:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587044.525644:0:15404:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f5bb5b5e800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587044.525649:0:15404:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8f5bb4c98000) has exports, disconnecting them 00000020:00080000:0.0:1788587044.525653:0:15404:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f5bb5b5e800), last request at 1788586828 00000020:00000080:0.0:1788587044.525657:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9522 00000020:00080000:0.0:1788587044.525667:0:15404:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bb5b5e800): rc 0 00000020:00000080:0.0:1788587044.525670:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b5e800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788587044.526086:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb4cb6800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788587044.526095:0:36:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587044.526097:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788587044.526102:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788587044.526202:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae580800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788587044.526205:0:36:0:(genops.c:885:class_export_put()) final put ffff8f5bae583800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788587044.526207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae583800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788587044.526210:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788587044.526356:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae586000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587044.526361:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b5e800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788587044.538485:0:15404:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788587044.538508:0:15404:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587044.538512:0:15404:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788587044.538520:0:15404:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587044.538552:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb5b5d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788587044.538798:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587044.538808:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788587044.538814:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b5f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788587044.538818:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b5f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788587044.538829:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788587044.538926:0:15404:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5baaa5e000 1 00000020:00000080:1.0:1788587044.538936:0:15404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd945e 00000020:00000080:1.0:1788587044.539354:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5bb4cb7800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788587044.539367:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788587044.539377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4cb7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587044.539390:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587044.539395:0:15404:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587044.539399:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8f5bb4c9b380) has no exports 00000020:00000080:1.0:1788587044.618529:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587044.618546:0:15404:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788587044.618553:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5baaa5f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788587044.618558:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5baaa5f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788587044.618737:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788587044.619696:0:15404:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f5baaa5f800 00000020:01000000:1.0:1788587044.619724:0:15404:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788587044.619729:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587044.619734:0:15404:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587044.619738:0:15404:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8f5b86d53380) has no exports 00000100:00100000:1.0:1788587044.620018:0:10048:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f5a8310d000:10048] 3 exiting: rc = 0 00000100:00100000:3.0:1788587044.620019:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f5b84e04000:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1788587044.620319:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f5bad589600:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1788587044.620435:0:13553:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8f5a81bc1400:13553] 4 exiting: rc = 0 00000100:00100000:1.0:1788587044.621863:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f5bad589000:6522] 2 exiting: rc = 0 00000100:00100000:0.0:1788587044.621924:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621937:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621943:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621949:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621954:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621958:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621975:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621980:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621985:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621990:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.621995:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622000:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622006:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622012:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622017:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622023:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622028:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622032:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622037:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622043:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622049:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622112:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622129:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622135:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622140:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622145:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622153:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622159:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622164:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622170:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622177:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622182:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622188:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622193:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622199:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622206:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622211:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622217:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622223:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622229:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622234:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622247:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622253:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622259:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622266:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622270:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622276:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622293:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622301:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622306:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622311:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622317:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622322:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622328:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622334:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622340:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622356:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622362:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622367:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622372:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622377:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622382:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622387:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.622401:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587044.625767:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f5b879db600:6524] 1 exiting: rc = 0 00000100:00100000:0.0:1788587044.625922:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f5bad588000:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1788587044.626168:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626178:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626210:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626218:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626226:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626234:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626243:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626250:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626258:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626268:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626276:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626285:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626293:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626301:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626308:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626507:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626512:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626518:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626523:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626528:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626533:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626539:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626544:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626549:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626554:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626559:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626564:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626637:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626646:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626652:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626657:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626662:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626670:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626678:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626686:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626693:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626701:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626715:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626723:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626730:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626739:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626746:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626752:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626834:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626841:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626849:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626859:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626869:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626879:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626884:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626890:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626895:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626900:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626904:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626910:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626914:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626926:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626933:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626939:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626946:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626952:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626960:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626967:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.626975:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.627860:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f5baabc2600:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1788587044.627867:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f5ba7cbdc00:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1788587044.627972:0:7898:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8f5bbc95b200:7898] 2 exiting: rc = 0 00000100:00100000:0.0:1788587044.628277:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628287:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628293:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628299:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628305:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628311:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628317:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628323:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628329:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628336:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628352:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628358:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628364:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628384:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628390:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628396:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628402:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628409:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628477:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628486:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628492:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628498:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628504:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628512:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628590:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628684:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628692:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628699:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628705:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628711:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628717:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628723:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628729:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628736:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628742:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628747:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628753:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628773:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628780:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628786:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628792:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628798:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628804:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628810:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628816:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628829:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628834:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628841:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628846:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628867:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628874:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628880:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628886:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628903:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628911:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628917:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628925:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628931:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628936:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628942:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628948:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628954:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628958:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.628971:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587044.649282:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f5ba0722c00:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1788587044.649712:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f5baabc2a00:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1788587044.649832:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649839:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649845:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649850:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649856:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649860:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649866:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649882:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649887:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649892:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649898:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649903:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649908:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649913:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649918:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649922:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649927:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649932:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649938:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649942:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649947:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649951:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649957:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649962:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649967:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649972:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649977:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649982:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649987:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649992:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.649997:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650002:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650006:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650011:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650016:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650021:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650026:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650031:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650036:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650041:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650047:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650106:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650129:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650135:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650140:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650144:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650149:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650154:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650159:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650163:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650168:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650172:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650176:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650180:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650185:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650189:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650193:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650198:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650202:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650208:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650213:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650218:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650222:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.650226:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587044.650954:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f5bb0689800:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1788587044.651192:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f5b90708800:6529] 0 exiting: rc = 1 00000100:00100000:1.0:1788587044.651289:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651296:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651301:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651306:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651312:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651317:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651322:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651327:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651333:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651338:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651343:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651349:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651354:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651369:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651374:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651379:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651384:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651389:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651395:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651400:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651405:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651411:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651675:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651684:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651690:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651695:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651700:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651705:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651710:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651715:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651720:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651725:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651730:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651735:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651740:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651745:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651751:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651756:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651761:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651767:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651773:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651778:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651784:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651790:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651795:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651800:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651805:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651809:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651821:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651826:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651831:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651835:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651840:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651845:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651850:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651855:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651860:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651865:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651870:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651874:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651879:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651884:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651888:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.651893:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587044.652363:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f5b90709c00:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1788587044.652778:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f5bb0688200:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1788587044.652900:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652909:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652916:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652921:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652926:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652931:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652937:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652941:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652946:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652951:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652957:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652962:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652967:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652971:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652976:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652981:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652987:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652992:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.652997:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653010:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653015:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653020:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653025:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653030:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653035:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653040:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653045:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653111:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653127:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653132:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653137:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653142:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653147:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653151:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653157:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653162:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653167:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653171:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653176:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653180:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653185:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653190:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653194:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653199:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653203:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653208:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653213:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653217:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653222:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653228:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653233:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653238:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653242:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653247:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653262:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653268:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653272:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653277:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653282:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653286:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653291:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653296:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653300:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.653304:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587044.654314:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f5b90709600:6533] 0 exiting: rc = 1 00000100:00100000:3.0:1788587044.654571:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f5b8856aa00:6535] 2 exiting: rc = 0 00000100:00100000:0.0:1788587044.654957:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f5bb0689e00:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1788587044.655123:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655131:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655137:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655142:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655148:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655160:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655180:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655186:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655191:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655196:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655201:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655206:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655211:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655216:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655221:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655226:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655231:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655237:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655241:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655247:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655252:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655257:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655263:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655269:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655275:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655291:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655296:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655304:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655309:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655315:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655332:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655338:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655343:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655348:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655355:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655361:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655366:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655371:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655376:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655382:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655388:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655394:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655399:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655405:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655410:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655836:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655845:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655850:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655856:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655862:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655867:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655873:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655878:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655883:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655902:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655908:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655913:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655919:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655924:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655929:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655941:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655947:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655954:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587044.655959:0:15404:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788587044.663271:0:15404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587044.663285:0:15404:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788587044.663291:0:15404:0:(genops.c:885:class_export_put()) final put ffff8f5b86e77000/MDS_uuid 00000020:00000080:1.0:1788587044.663295:0:15404:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b86e77000/MDS_uuid for MDS 00000020:01000000:1.0:1788587044.663301:0:15404:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788587044.663477:0:15404:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788587045.333566:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587046.357392:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587047.382454:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587048.003218:0:15604:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788587048.024894:0:15604:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788587048.024953:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587048.024969:0:15604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587048.024976:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587048.024982:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587048.025002:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788587048.025007:0:15604:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788587048.025032:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587048.025037:0:15604:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788587048.025043:0:15604:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788587048.025049:0:15604:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788587048.025054:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587048.025068:0:15604:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788587048.025072:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788587048.025756:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587048.025764:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587048.025772:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8318b400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587048.025775:0:10387:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587048.025795:0:10387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587048.025801:0:10387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587048.025806:0:10387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587048.025809:0:10387:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788587048.025811:0:10387:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788587048.025826:0:10387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:0.0:1788587048.025830:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587048.025835:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318b400/0xfbc93bbea5fd98c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98cc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587048.025847:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587048.025848:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587048.025850:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587048.027061:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587048.027069:0:15604:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788587048.027076:0:15604:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788587048.027119:0:15604:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788587048.027199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875469127542016:0@lo:39:umount.0 00000400:00000100:0.0:1788587048.027252:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469127542016 offset 0 length 224: 4 00010000:00010000:0.0:1788587048.404840:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587049.300659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587049.300669:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587049.300673:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587049.300676:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788587049.300680:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587049.300689:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 390 00000100:00080000:2.0:1788587049.300694:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587049.300701:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f5a83355000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587049.300741:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84520700 x1875469127542144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587049.300825:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127542144:0@lo:38:kworker.0 00000400:00000100:0.0:1788587049.300875:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469127542144 offset 0 length 520: 4 00000100:00100000:1.0:1788587049.301822:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127542272:0@lo:400:kworker.0 00000400:00000100:1.0:1788587049.301857:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469127542272 offset 0 length 224: 4 00010000:00010000:2.0:1788587049.428825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587049.818247:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587049.818257:0:8429:0:(genops.c:885:class_export_put()) final put ffff8f5a81bcd000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788587049.819026:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788587049.819032:0:9513:0:(genops.c:885:class_export_put()) final put ffff8f5a81bc8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587049.819408:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bcd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788587049.819465:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a81bc8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788587049.819482:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a81bcc800 for lustre-OST0000 00000020:00000080:2.0:1788587049.819486:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a81bc9000 for lustre-OST0001 00010000:00010000:3.0:1788587050.452703:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587051.476796:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587052.500658:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587053.524601:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587054.420549:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587044/real 1788587044] req@ffff8f5bb4e36d80 x1875469127541504/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587054.420580:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5bb4e36d80 x1875469127541504/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587054.420602:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587054.420625:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788587054.420629:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127541504:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788587054.422514:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587054.422534:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788587054.422538:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587054.422546:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.101@tcp: connect to NID 0@lo last attempt 390 00000100:00080000:2.0:1788587054.422553:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788587054.422560:0:38:0:(import.c:665:import_select_connection()) MGC192.168.203.101@tcp: import ffff8f5bb069c000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587054.422596:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84521180 x1875469127542400/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587054.422641:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587054.422645:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587054.422690:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587054.422758:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127542528:0@lo:400:kworker.0 00000100:00100000:3.0:1788587054.422762:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127542400:0@lo:250:kworker.0 00000400:00000100:3.0:1788587054.428167:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469127542400 offset 0 length 520: 4 00000400:00000100:2.0:1788587054.428167:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469127542528 offset 0 length 224: 4 00010000:00010000:0.0:1788587054.549352:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587055.573379:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587056.596672:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587057.620807:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587058.516673:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587048/real 1788587048] req@ffff8f5a84522a00 x1875469127542016/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587058 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587058.516745:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84522a00 x1875469127542016/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587058 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587058.516766:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788587058.516783:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875469127542016:0@lo:39:umount.0 00000100:00080000:2.0:1788587058.516866:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587058.516870:0:15604:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587058.516875:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788587058.517739:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517754:0:15604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517762:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517768:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517798:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587058.517805:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517812:0:15604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517835:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517841:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587058.517957:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788587058.517963:0:15604:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788587058.517993:0:15604:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788587058.517997:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788587058.518003:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587058.518009:0:15604:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587058.518013:0:15604:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f5ba7ab3380) has no exports 00000020:00080000:2.0:1788587058.518047:0:15604:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f5ba7ab3380) has no exports 00000020:01000000:2.0:1788587058.519617:0:15604:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5a8277eba0 - data ffff8f5bb12ff0d8/ffff8f5bbcbfe000 00000020:01000000:2.0:1788587058.519736:0:15604:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5bbc97a0c0 - data ffff8f5bb12bb0d8/ffff8f5bbdbbc000 00010000:00010000:3.0:1788587058.521517:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587058.521531:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521561:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecdc00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587058.521565:0:10387:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521575:0:10387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587058.521582:0:10387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587058.521587:0:10387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587058.521590:0:10387:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788587058.521594:0:10387:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788587058.521612:0:10387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:3.0:1788587058.521616:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521622:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecdc00/0xfbc93bbea5fd98d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98da expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521639:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587058.521642:0:10387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521648:0:10387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b91ecc600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587058.521651:0:10387:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521658:0:10387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587058.521671:0:10387:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587058.521676:0:10387:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788587058.521679:0:10387:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788587058.521681:0:10387:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788587058.521687:0:10387:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:3.0:1788587058.521690:0:10387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521697:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b91ecc600/0xfbc93bbea5fd9b1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd9b26 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587058.521706:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587058.521708:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587058.521711:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587058.522059:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788587058.536188:0:15604:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788587058.551818:0:15604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd95fb 00000020:00000080:3.0:1788587058.551835:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b6c800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788587058.552014:0:15604:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bae583000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788587058.552019:0:15604:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bae583000 2 00000020:01000004:3.0:1788587058.552030:0:15604:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f5bae583000 from lustre-OST0000 00000020:00000080:3.0:1788587058.552059:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587058.552068:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788587058.552072:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b69800/lustre-OST0000_UUID 00000020:00000080:3.0:1788587058.552075:0:15604:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b69800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788587058.552082:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788587058.552148:0:15604:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788587058.552152:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788587058.552156:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587058.552160:0:15604:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587058.552184:0:15604:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f5bbc98b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587058.552190:0:15604:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8f5ba7ab0000) has exports, disconnecting them 00000020:00080000:3.0:1788587058.552195:0:15604:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f5bbc98b000), last request at 1788586847 00000020:00000080:3.0:1788587058.552199:0:15604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9625 00000020:00080000:3.0:1788587058.552209:0:15604:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5bbc98b000): rc 0 00000020:00000080:3.0:1788587058.552213:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5bbc98b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788587058.554369:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b6c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788587058.558356:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbc98b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788587058.558398:0:15604:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788587058.558403:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587058.558406:0:15604:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587058.558412:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587058.558769:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a822e2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788587058.558841:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587058.558849:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788587058.558855:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5a8227b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788587058.558858:0:15604:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a8227b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788587058.558863:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788587058.558934:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788587058.558938:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587058.558942:0:15604:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587058.558949:0:15604:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f5a822e4800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587058.558955:0:15604:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8f5a82434d40) has exports, disconnecting them 00000020:00080000:0.0:1788587058.558960:0:15604:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f5a822e4800), last request at 1788586847 00000020:00000080:0.0:1788587058.558964:0:15604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd963a 00000020:00080000:0.0:1788587058.558976:0:15604:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5a822e4800): rc 0 00000020:00000080:0.0:1788587058.558981:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5a822e4800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788587058.559054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a822e4800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788587058.560193:0:15604:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788587058.560199:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788587058.560203:0:15604:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788587058.560208:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587058.560226:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a822e7000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788587058.560516:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587058.560523:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788587058.560528:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5a822e5800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788587058.560531:0:15604:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a822e5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788587058.560536:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788587058.560596:0:15604:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bae583000 1 00000020:00000080:1.0:1788587058.560602:0:15604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd95c3 00000020:00000080:1.0:1788587058.560607:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b5a000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788587058.560625:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788587058.560632:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b5a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788587058.560640:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587058.560644:0:15604:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587058.560647:0:15604:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8f5bae574d40) has no exports 00000020:00000080:1.0:1788587058.722711:0:15604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587058.722728:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788587058.722734:0:15604:0:(genops.c:885:class_export_put()) final put ffff8f5bae581800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788587058.722740:0:15604:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bae581800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788587058.722754:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788587058.723005:0:15604:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f5bae584000 00000020:02000400:1.0:1788587058.723065:0:15604:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788587058.753791:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587059.540792:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587059.540802:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587059.540805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587059.540808:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587059.540881:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587059.540899:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127542656:0@lo:400:kworker.0 00000400:00000100:1.0:1788587059.540958:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469127542656 offset 0 length 224: 4 00010000:00010000:3.0:1788587059.796566:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587060.823349:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587061.816294:0:15806:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788587061.827159:0:15806:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788587061.827239:0:15806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587061.827254:0:15806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587061.827260:0:15806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587061.827280:0:15806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587061.827305:0:15806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587061.827311:0:15806:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788587061.827335:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587061.827345:0:15806:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5a84520700 x1875469127542144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587069 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587061.827365:0:15806:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587061.827371:0:15806:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587061.827381:0:15806:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788587061.827386:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587061.827389:0:15806:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5a84520700 x1875469127542144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587069 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587061.827396:0:15806:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587061.827398:0:15806:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:0.0:1788587061.827882:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587061.827891:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587061.827899:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4800 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587061.827903:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587061.827911:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587061.827926:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587061.827932:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587061.827935:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788587061.827938:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788587061.827952:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:0.0:1788587061.827956:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587061.827963:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4800/0xfbc93bbea5fd989b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587061.827976:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587061.827978:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587061.827980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587061.829836:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127542144:0@lo:38:kworker.0 00000100:00080000:1.0:1788587061.831182:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788587061.831197:0:15806:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5a84522300 x1875469127542272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587065 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587061.831225:0:15806:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5a84520e00 x1875469127542528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587070 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587061.831237:0:15806:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5bb4e36a00 x1875469127542656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587075 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587061.831275:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127542272:0@lo:400:kworker.0 00000100:00100000:2.0:1788587061.831348:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127542528:0@lo:400:kworker.0 00000100:00100000:1.0:1788587061.831371:0:15806:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587061.831378:0:15806:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788587061.831761:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127542656:0@lo:400:kworker.0 00000100:00080000:1.0:1788587061.832225:0:15806:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6cd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788587061.832312:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875469127542784:0@lo:39:umount.0 00000400:00000100:2.0:1788587061.832356:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469127542784 offset 0 length 224: 4 00010000:00010000:3.0:1788587061.844701:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587062.868725:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587063.894393:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587064.663560:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587064.663568:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788587064.916830:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587065.941286:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587066.964729:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587067.990826:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587069.012547:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587054/real 1788587054] req@ffff8f5a84521180 x1875469127542400/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587069 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587069.012583:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84521180 x1875469127542400/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587069 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788587069.012603:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587069.012627:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788587069.012631:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127542400:0@lo:250:kworker.0 00000100:00080000:1.0:1788587069.012744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587069.012749:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788587069.012752:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587069.012756:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.101@tcp: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1788587069.012762:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.101@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587069.012768:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.101@tcp: import ffff8f5bb069c000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587069.012796:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e37480 x1875469127542912/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587069.012921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127542912:0@lo:250:kworker.0 00000400:00000100:0.0:1788587069.012976:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469127542912 offset 0 length 520: 4 00010000:00010000:1.0:1788587069.017647:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587070.042040:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587071.062623:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587061/real 1788587061] req@ffff8f5bb4e34700 x1875469127542784/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587071 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587071.062655:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5bb4e34700 x1875469127542784/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587071 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587071.062672:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bad6cd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788587071.062709:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875469127542784:0@lo:39:umount.0 00010000:00010000:3.0:1788587071.062882:0:10387:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587071.064009:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788587071.064015:0:15806:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587071.064021:0:15806:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788587071.065737:0:15806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065753:0:15806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065760:0:15806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065768:0:15806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065797:0:15806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587071.065804:0:15806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065828:0:15806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065834:0:15806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065839:0:15806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.065858:0:15806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788587071.065863:0:15806:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788587071.065886:0:15806:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1788587071.066334:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587071.066349:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.066357:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4200 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587071.066360:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.066369:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587071.066375:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587071.066380:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587071.066382:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788587071.066385:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788587071.066399:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:0.0:1788587071.066403:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.066409:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b829f4200/0xfbc93bbea5fd98a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd98b0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.067028:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587071.067033:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.067051:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:0.0:1788587071.067067:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.067073:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587071.067079:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587071.067084:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587071.067086:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788587071.067088:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788587071.067096:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:0.0:1788587071.067099:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.067106:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b80031000/0xfbc93bbea5fd9b11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd9b18 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587071.067121:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587071.067122:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587071.067230:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587071.067280:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788587071.067684:0:15806:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788587071.067692:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587071.067700:0:15806:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587071.067704:0:15806:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8f5bb4c999c0) has no exports 00000020:00080000:1.0:1788587071.067729:0:15806:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8f5bb4c999c0) has no exports 00000020:01000000:1.0:1788587071.078288:0:15806:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5a832b91e0 - data ffff8f5bb13201b0/ffff8f5a827e7400 00000020:01000000:1.0:1788587071.078738:0:15806:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f5a8279b840 - data ffff8f5bb118b948/ffff8f5a83717400 00100000:10000000:1.0:1788587071.086673:0:15806:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788587071.104263:0:15806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9721 00000020:00000080:1.0:1788587071.104276:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5bb4e49800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788587071.104329:0:15806:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bbcb3b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788587071.104333:0:15806:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bbcb3b800 2 00000020:01000004:1.0:1788587071.104336:0:15806:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f5bbcb3b800 from lustre-OST0001 00000020:00000080:1.0:1788587071.104372:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587071.104383:0:15806:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788587071.104386:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5a8227e000/lustre-OST0001_UUID 00000020:00000080:1.0:1788587071.104389:0:15806:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a8227e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788587071.104404:0:15806:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788587071.104754:0:15806:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 47977fce-e1b1-4b0c-879f-0e023b1316c2->MGS 00010000:00010000:1.0:1788587071.104769:0:15806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7e00/0xfbc93bbea5fd947a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587071.104781:0:15806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7e00/0xfbc93bbea5fd947a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587071.104787:0:15806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788587071.104789:0:15806:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788587071.104792:0:15806:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788587071.104805:0:15806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:1.0:1788587071.104808:0:15806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5ba1aa7e00/0xfbc93bbea5fd947a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd9481 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587071.104822:0:15806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587071.104828:0:15806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587071.104832:0:15806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587071.104834:0:15806:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788587071.104836:0:15806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788587071.104843:0:15806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f5bb069c000 00010000:00010000:1.0:1788587071.104846:0:15806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8318a000/0xfbc93bbea5fd9943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xfbc93bbea5fd994a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788587071.104861:0:15806:0:(import.c:65:import_set_state_nolock()) ffff8f5bb069c000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788587071.104865:0:15806:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788587071.104867:0:15806:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788587071.104874:0:15806:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788587071.104879:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788587071.104898:0:15806:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f5bb4e37480 x1875469127542912/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788587089 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788587071.104978:0:15806:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788587071.104982:0:15806:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000020:00000080:2.0:1788587071.105210:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb4e49800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788587071.105263:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:47977fce-e1b1-4b0c-879f-0e023b1316c2:3645:1875469127542912:0@lo:250:kworker.0 10000000:01000000:1.0:1788587071.105319:0:15806:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788587071.105329:0:15806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9377 00000020:00000080:1.0:1788587071.105335:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5b86e76800/47977fce-e1b1-4b0c-879f-0e023b1316c2 00000020:01000000:1.0:1788587071.105399:0:15806:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.101@tcp (flags='') 00000020:00000080:1.0:1788587071.105404:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587071.105409:0:15806:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788587071.105413:0:15806:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8f5bb05e3380) has no exports 00000020:00000080:2.0:1788587071.105616:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5b86e76800/47977fce-e1b1-4b0c-879f-0e023b1316c2 for MGC192.168.203.101@tcp 10000000:01000000:2.0:1788587071.105642:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788587071.105721:0:15806:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.101@tcp: client import never connected 00000100:00080000:1.0:1788587071.105724:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788587071.105726:0:15806:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788587071.105728:0:15806:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788587071.105730:0:15806:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788587071.105765:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587071.105771:0:15806:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.101@tcp (uuid 47977fce-e1b1-4b0c-879f-0e023b1316c2) 00000020:01000000:1.0:1788587071.105776:0:15806:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788587071.105779:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587071.105782:0:15806:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587071.105787:0:15806:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f5a83356800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587071.105792:0:15806:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8f5a83343380) has exports, disconnecting them 00000020:00080000:1.0:1788587071.105796:0:15806:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f5a83356800), last request at 1788586867 00000020:00000080:1.0:1788587071.105800:0:15806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd974b 00000020:00080000:1.0:1788587071.105810:0:15806:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5a83356800): rc 0 00000020:00000080:1.0:1788587071.105813:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5a83356800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788587071.106634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a83356800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788587071.107266:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bb069c000 for MGC192.168.203.101@tcp 00000020:00000080:3.0:1788587071.107276:0:36:0:(genops.c:885:class_export_put()) final put ffff8f5bb069a800/47977fce-e1b1-4b0c-879f-0e023b1316c2 00000020:00000080:3.0:1788587071.107278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb069a800/47977fce-e1b1-4b0c-879f-0e023b1316c2 for MGC192.168.203.101@tcp 00000020:01000000:3.0:1788587071.107289:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.101@tcp (47977fce-e1b1-4b0c-879f-0e023b1316c2) 00010000:01000000:3.0:1788587071.108968:0:15806:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788587071.108976:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587071.108980:0:15806:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788587071.108987:0:15806:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587071.109130:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587071.109138:0:15806:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788587071.109155:0:15806:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788587071.109158:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587071.109163:0:15806:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587071.109169:0:15806:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f5a83351800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587071.109176:0:15806:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8f5a826e8000) has exports, disconnecting them 00000020:00080000:3.0:1788587071.109180:0:15806:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f5a83351800), last request at 1788586867 00000020:00000080:3.0:1788587071.109184:0:15806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd9760 00000020:00080000:3.0:1788587071.109198:0:15806:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f5a83351800): rc 0 00000020:00000080:3.0:1788587071.109203:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5a83351800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788587071.110097:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5a83355000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788587071.110109:0:36:0:(genops.c:885:class_export_put()) final put ffff8f5ba7ae1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788587071.110121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5ba7ae1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788587071.110128:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788587071.110185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5a83351800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788587071.149845:0:15806:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788587071.149853:0:15806:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587071.149858:0:15806:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788587071.150003:0:15806:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788587071.150161:0:10387:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788587071.150296:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788587071.150376:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788587071.150655:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f5bb0619200:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1788587071.150702:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f5bb0618e00:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1788587071.150749:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151116:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f5bb0619000:6508] 2 exiting: rc = 0 00000100:00100000:2.0:1788587071.151176:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f5bb0619400:6507] 1 exiting: rc = 0 00000100:00100000:2.0:1788587071.151237:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f5bb0618600:6506] 0 exiting: rc = 1 00000100:00100000:2.0:1788587071.151289:0:8450:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f5a81bc4000:8450] 3 exiting: rc = 0 00000100:00100000:2.0:1788587071.151335:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151343:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151349:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151355:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151360:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151365:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151371:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151376:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151383:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151388:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151406:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151412:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151648:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151655:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151661:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151666:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151672:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151678:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151684:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151691:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151698:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151703:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151708:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151713:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151717:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151722:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151727:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151731:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151736:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151741:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151745:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151750:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151754:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151759:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151764:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151769:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151774:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151779:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151783:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151788:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151793:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151798:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151803:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151808:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151814:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151826:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151831:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151836:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151841:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151846:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151851:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151856:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151861:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151866:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151870:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151875:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151880:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.151884:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.152186:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.152196:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.152201:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.152206:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.152210:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587071.152216:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788587071.153000:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f5bad6cd800 for lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788587071.153612:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587071.153621:0:15806:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788587071.153627:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5bad6cd000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788587071.153631:0:15806:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bad6cd000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788587071.153636:0:15806:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788587071.153683:0:15806:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bbcb3b800 1 00000020:00000080:2.0:1788587071.153688:0:15806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xfbc93bbea5fd96f0 00000020:00000080:2.0:1788587071.153694:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5bbcb3a000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788587071.153743:0:15806:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788587071.153747:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587071.153751:0:15806:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587071.153754:0:15806:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8f5a82433380) has no exports 00000020:00000080:1.0:1788587071.158681:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbcb3a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788587071.206827:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587071.206841:0:15806:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788587071.206848:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5bbcb38800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788587071.206853:0:15806:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bbcb38800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788587071.206858:0:15806:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788587071.207187:0:15806:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f5bbcb3e000 00000020:01000000:3.0:1788587071.207207:0:15806:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788587071.207211:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587071.207214:0:15806:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788587071.207218:0:15806:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8f5baf193380) has no exports 00000020:00000080:3.0:1788587071.207239:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587071.207243:0:15806:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788587071.207246:0:15806:0:(genops.c:885:class_export_put()) final put ffff8f5bb5b5b000/OSS_uuid 00000020:00000080:3.0:1788587071.207248:0:15806:0:(genops.c:844:class_export_destroy()) destroying export ffff8f5bb5b5b000/OSS_uuid for OSS 00000020:01000000:3.0:1788587071.207251:0:15806:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788587071.207351:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f5bb4e87800:8436] 2 exiting: rc = 0 00000100:00100000:3.0:1788587071.207501:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f5bb4e3d000:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1788587071.207618:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f5bb4e90600:8434] 1 exiting: rc = 0 00000100:00080000:3.0:1788587071.207658:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788587071.207752:0:10047:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f5a822dde00:10047] 3 exiting: rc = 0 00000100:00100000:3.0:1788587071.207816:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207824:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207838:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207848:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207855:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207861:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207866:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207871:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207876:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207882:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207886:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207891:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207896:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207901:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207906:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207911:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207915:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207920:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207924:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207929:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207933:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207950:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207956:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207961:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207966:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207971:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207976:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207981:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207986:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207991:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.207996:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208000:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208006:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208010:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208015:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208019:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208024:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208034:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208039:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208043:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208048:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208053:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208059:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208064:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208069:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208074:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208079:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208083:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208088:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208093:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208098:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208102:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208107:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208112:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208117:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208122:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208127:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208132:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208137:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208142:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208147:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208156:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208161:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.208169:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.217313:0:13446:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8f5a83625800:13446] 2 exiting: rc = 0 00000100:00100000:0.0:1788587071.217409:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f5bb4e87600:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1788587071.219037:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f5bb59fd400:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1788587071.221129:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221142:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221149:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221155:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221178:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221183:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221188:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221193:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221198:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221204:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221209:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221215:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221220:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221225:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221230:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221235:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221240:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221252:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221258:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221263:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221281:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221286:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221292:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221297:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221302:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221308:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221314:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221318:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221324:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221329:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221335:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221340:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221346:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221351:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221357:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221362:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221366:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221370:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221375:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221389:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221394:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221400:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221405:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221410:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221436:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221443:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221448:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221453:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221461:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221467:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221472:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221477:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221483:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221488:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221493:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221498:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221505:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221510:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221515:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221519:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221524:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221530:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221535:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.221549:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587071.222398:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f5ba7c9ba00:8440] 1 exiting: rc = 0 00000100:00100000:0.0:1788587071.222409:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f5b88569200:8441] 2 exiting: rc = 0 00000100:00100000:0.0:1788587071.222594:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f5bbc868400:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1788587071.222656:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222663:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222669:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222675:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222680:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222686:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222691:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222697:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222714:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222720:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222733:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222740:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222745:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222750:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222755:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222760:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222766:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222772:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222778:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222784:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222789:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222794:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222800:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222805:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222811:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222816:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222822:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222827:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222833:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222838:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222845:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222851:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222857:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222862:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222885:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222895:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222902:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222914:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222925:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.222932:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223356:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223365:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223371:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223386:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223391:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223397:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223402:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223407:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223412:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223445:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223450:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223455:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223460:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223466:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223471:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223476:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223481:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223486:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223492:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223497:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223502:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223508:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223513:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.223519:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237525:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f5bae500c00:8443] 1 exiting: rc = 0 00000100:00100000:1.0:1788587071.237682:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f5bb4e42600:8442] 0 exiting: rc = 1 00000100:00100000:0.0:1788587071.237862:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237870:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237875:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237881:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237885:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237891:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237896:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237901:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237906:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237911:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237915:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237923:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237928:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237958:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237963:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237967:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237972:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237981:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237986:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.237991:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238025:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238031:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238036:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238088:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238094:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238098:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238104:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238108:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238113:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238118:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238123:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238194:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238198:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238203:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238208:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238212:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238217:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238222:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238227:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238231:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238236:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238241:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238245:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238250:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238255:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238261:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238267:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238272:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238284:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238289:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238294:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238300:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238305:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238311:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238316:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238320:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238324:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238329:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238334:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.238339:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.240782:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.240791:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.240796:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.240801:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587071.242119:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f5baf1c3200:8444] 0 exiting: rc = 1 00000100:00100000:3.0:1788587071.249323:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f5baf1c3800:8445] 1 exiting: rc = 0 00000100:00100000:0.0:1788587071.249480:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249505:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249534:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249541:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249548:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249554:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249560:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249566:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249572:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249578:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249584:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249590:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249596:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249602:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249623:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249630:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249636:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249643:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249649:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249669:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249674:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249680:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249685:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249691:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249696:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249702:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249721:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249727:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249732:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249738:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249744:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249750:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249755:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249763:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249768:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249773:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249779:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249784:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249802:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249809:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249814:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249820:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249826:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249832:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249837:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249843:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249849:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249855:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249860:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249866:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249887:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249895:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249901:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249907:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249921:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249926:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249931:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249948:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249953:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249959:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249964:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249970:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.249990:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587071.250002:0:15806:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788587071.272959:0:15806:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788587089.391626:0:16571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788587099.429063:0:17170:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587099.429081:0:17170:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788587099.429083:0:17170:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788587099.429193:0:17170:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f5a8450b800 00000020:01000004:2.0:1788587099.429209:0:17170:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788587099.429217:0:17170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788587099.429235:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f5a82430000) 00000020:00000080:2.0:1788587099.429250:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788587099.489478:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788587099.490197:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788587099.492953:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788587099.493144:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788587099.493595:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788587099.493843:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788587099.494847:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788587099.495157:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788587099.495581:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.495824:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788587099.496100:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788587099.496489:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.496908:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788587099.497367:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.498003:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.500825:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.501078:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.501613:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.502030:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.502329:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.502737:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.503060:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.503323:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.503646:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.503912:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.504102:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.504350:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.504736:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.504983:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.505330:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.505717:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.505914:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.506088:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.506312:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.506660:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.506963:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.507469:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.507812:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.508025:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.508183:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.508509:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.508754:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.508926:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.509085:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788587099.509271:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.509890:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.510135:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788587099.511327:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.511905:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.512097:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.512664:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.512919:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788587099.513155:0:17170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788587099.513974:0:17170:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788587099.514174:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788587099.514183:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587099.514196:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda934 00000020:01000004:3.0:1788587099.514203:0:17170:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788587099.514207:0:17170:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788587099.514212:0:17170:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5a8450b800 from MGS 00000020:01000004:3.0:1788587099.514217:0:17170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788587099.514226:0:17170:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f5baf1919c0) 00000020:00000080:3.0:1788587099.514249:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788587099.514309:0:17170:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a8450b800 from MGS, refs=2 00080000:01000000:3.0:1788587099.514321:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788587099.514328:0:17170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda942 00000100:00100000:3.0:1788587099.514770:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788587099.514911:0:17170:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788587099.514917:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788587099.515665:0:17170:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788587099.515672:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788587099.516335:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587099.516980:0:17170:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788587099.516987:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788587099.519755:0:17170:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788587099.519770:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788587099.520202:0:17170:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788587099.520209:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788587099.521176:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.521179:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.521181:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.522035:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.522039:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.522041:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587099.522678:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788587099.529818:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788587099.534200:0:17170:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788587099.544665:0:17182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788587099.544776:0:17170:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788587099.544842:0:17170:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788587099.551506:0:17170:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788587099.551842:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587099.552402:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788587099.552409:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788587099.553045:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788587099.553052:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788587099.553479:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788587099.553485:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788587099.554208:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788587099.554228:0:17170:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.101@tcp' 00000020:01000004:1.0:1788587099.554230:0:17170:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1788587099.554334:0:17187:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:1.0:1788587099.554375:0:17170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.101@tcp (typ=mgc) 00000020:00000080:1.0:1788587099.554387:0:17170:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.101@tcp (ffff8f5a83343380) 00000020:00000080:1.0:1788587099.554400:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788587099.554663:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5b88e47000@MGC192.168.203.101@tcp: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788587099.554816:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.101@tcp-0 is initialized 00000040:01000000:1.0:1788587099.554822:0:17170:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788587099.555826:0:17188:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788587099.555902:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.101@tcp (uuid bf956867-663d-4ecf-b775-8366b2c643ae) 00000020:00000080:3.0:1788587099.555919:0:17170:0:(genops.c:1385:class_connect()) connect: client bf956867-663d-4ecf-b775-8366b2c643ae, cookie 0xfbc93bbea5fda950 00000100:00080000:3.0:1788587099.555931:0:17170:0:(import.c:545:import_select_connection()) MGC192.168.203.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587099.555937:0:17170:0:(import.c:665:import_select_connection()) MGC192.168.203.101@tcp: import ffff8f5b88e47000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587099.555968:0:17170:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83108700 x1875469127543040/t0(0) o250->MGC192.168.203.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587099.555994:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bf956867-663d-4ecf-b775-8366b2c643ae->MGS 00000020:01000004:3.0:1788587099.556046:0:17170:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788587099.556050:0:17170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788587099.556069:0:17170:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f5baf194d40) 00000020:00000080:3.0:1788587099.556080:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788587099.556250:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf956867-663d-4ecf-b775-8366b2c643ae:3645:1875469127543040:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788587099.556314:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.558074:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543040 00000100:00100000:0.0:1788587099.558086:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543040 00000100:00100000:0.0:1788587099.558130:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587099.558137:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1875469127543040:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788587099.558160:0:17184:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bf956867-663d-4ecf-b775-8366b2c643ae@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:0.0:1788587099.558185:0:17184:0:(genops.c:1385:class_connect()) connect: client bf956867-663d-4ecf-b775-8366b2c643ae, cookie 0xfbc93bbea5fda95e 00000100:00080000:0.0:1788587099.558306:0:17184:0:(import.c:65:import_set_state_nolock()) ffff8f5bad68d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587099.558376:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+5:3645:x1875469127543040:12345-0@lo:250:mount.lustre.0 Request processed in 238us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.558383:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587099.558446:0:3645:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788587099.558455:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.101@tcp: connect to target with instance 0 00000100:00080000:0.0:1788587099.558462:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788587099.558467:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788587099.558471:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5b88e47000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788587099.558480:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788587099.558488:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788587099.558494:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bf956867-663d-4ecf-b775-8366b2c643ae:3645:1875469127543040:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788587099.568387:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587099.568730:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587099.568736:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788587099.570916:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587099.570930:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788587099.573061:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788587099.573074:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788587099.575894:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587099.576074:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788587099.576080:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788587099.577015:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788587099.577023:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788587099.646297:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587099.647110:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788587099.647118:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788587099.648695:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788587099.648708:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788587099.649344:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587099.649565:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788587099.649570:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788587099.650111:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788587099.650117:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788587099.650664:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587099.650814:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788587099.650819:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788587099.654664:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788587099.654681:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788587099.656717:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587099.656901:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788587099.656908:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788587099.661559:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788587099.661581:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788587099.687119:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587099.687693:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788587099.687699:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788587099.693812:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587099.693905:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788587099.694985:0:17170:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587099.694994:0:17170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788587099.695859:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788587099.695888:0:17170:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788587099.695901:0:17170:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788587099.696007:0:17170:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788587099.696041:0:17170:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.101@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788587099.696045:0:17170:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788587099.696046:0:17170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587099.696048:0:17170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587099.696049:0:17170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587099.696051:0:17170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587099.696052:0:17170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587099.696053:0:17170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587099.696055:0:17170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587099.696056:0:17170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587099.696057:0:17170:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587099.696060:0:17170:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788587099.696063:0:17170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587099.696064:0:17170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587099.696065:0:17170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587099.696067:0:17170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587099.696068:0:17170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587099.696069:0:17170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587099.696070:0:17170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587099.696071:0:17170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587099.696072:0:17170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587099.696073:0:17170:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587099.696098:0:17170:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788587099.696117:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543168:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587099.696207:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.696252:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587099.696468:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543168 00000100:00100000:0.0:1788587099.696476:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543168 00000100:00100000:0.0:1788587099.696510:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587099.696518:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+5:17170:x1875469127543168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587099.696559:0:17186:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788587099.696562:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788587099.696565:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788587099.696846:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788587099.697328:0:17186:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788587099.699299:0:17208:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788587099.699306:0:17208:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788587099.699309:0:17208:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788587099.699311:0:17208:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788587099.699529:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788587099.699696:0:17186:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788587099.699706:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788587099.701944:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+5:17170:x1875469127543168:12345-0@lo:253:mount.lustre.0 Request processed in 5417us (5741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.701958:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587099.702070:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587099.702085:0:17170:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788587099.702088:0:17170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587099.702090:0:17170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587099.702091:0:17170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587099.702093:0:17170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587099.702095:0:17170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587099.702096:0:17170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587099.702108:0:17170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587099.702109:0:17170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587099.702111:0:17170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587099.702112:0:17170:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587099.702132:0:17170:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5a8450b800 from lustre-MDT0000 10000000:01000000:2.0:1788587099.702162:0:17170:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788587099.702165:0:17170:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788587099.702170:0:17170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f5a83343380 10000000:01000000:2.0:1788587099.702175:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587099.702182:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f5a83343380 from 1 10000000:01000000:2.0:1788587099.702185:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788587099.702344:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.702355:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.702365:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.702384:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587099.702459:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.702488:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587099.702555:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543296 00000100:00100000:1.0:1788587099.702567:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543296 00000100:00100000:1.0:1788587099.702607:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587099.702615:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+5:17170:x1875469127543296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587099.702625:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587099.702638:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a466e00/0xfbc93bbea5fda96c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fda965 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.702659:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a466e00/0xfbc93bbea5fda96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fda965 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.702671:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a466e00/0xfbc93bbea5fda96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fda965 expref: 6 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.702680:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466e00, rc 0) 00000100:00100000:1.0:1788587099.702711:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+6:17170:x1875469127543296:12345-0@lo:101:mount.lustre.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.702716:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587099.702804:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587099.702817:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.702826:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.702888:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587099.702914:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.702935:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.702988:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543424 00000100:00100000:2.0:1788587099.702993:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543424 00000100:00100000:2.0:1788587099.703021:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587099.703028:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+6:17170:x1875469127543424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587099.703097:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+6:17170:x1875469127543424:12345-0@lo:501:mount.lustre.0 Request processed in 70us (182us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587099.703105:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587099.703325:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543424:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788587099.703350:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788587099.703368:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.703376:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587099.703383:0:17170:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5a8450b800 10000000:01000000:3.0:1788587099.703388:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788587099.703391:0:17170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f5a8450b800 10000000:01000000:3.0:1788587099.703393:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788587099.703396:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f5a8450b800 from 1 10000000:01000000:3.0:1788587099.703403:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788587099.703446:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.703454:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.703461:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.703473:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587099.703498:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.703509:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587099.703595:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543552 00000100:00100000:1.0:1788587099.703599:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543552 00000100:00100000:1.0:1788587099.703631:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587099.703637:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+6:17170:x1875469127543552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587099.703644:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587099.703654:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a467000/0xfbc93bbea5fda97a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fda973 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.703668:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a467000/0xfbc93bbea5fda97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fda973 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.703676:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a467000/0xfbc93bbea5fda97a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fda973 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.703689:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467000, rc 0) 00000100:00100000:1.0:1788587099.703726:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+7:17170:x1875469127543552:12345-0@lo:101:mount.lustre.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.703732:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587099.703924:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587099.703936:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda97a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.703944:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fda97a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587099.703955:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788587099.703970:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda97a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.703977:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a200/0xfbc93bbea5fda973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda97a expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587099.703982:0:17170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788587099.703986:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587099.703995:0:17170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f5a8450b800 10000000:01000000:3.0:1788587099.703998:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788587099.704001:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788587099.704003:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788587099.704018:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.704025:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.704031:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.704043:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587099.704069:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.704095:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587099.704158:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543680 00000100:00100000:1.0:1788587099.704162:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543680 00000100:00100000:1.0:1788587099.704192:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587099.704359:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+7:17170:x1875469127543680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587099.704368:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587099.704376:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a467c00/0xfbc93bbea5fda988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fda981 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.704390:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a467c00/0xfbc93bbea5fda988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fda981 expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.704396:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a467c00/0xfbc93bbea5fda988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fda981 expref: 8 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.704402:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467c00, rc 0) 00000100:00100000:1.0:1788587099.704463:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+8:17170:x1875469127543680:12345-0@lo:101:mount.lustre.0 Request processed in 108us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.704468:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587099.705472:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587099.705490:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda988 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.705499:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fda988 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.705572:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587099.705613:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.705695:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.709271:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543808 00000100:00100000:2.0:1788587099.709302:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543808 00000100:00100000:2.0:1788587099.709400:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587099.709411:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+8:17170:x1875469127543808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587099.709603:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+9:17170:x1875469127543808:12345-0@lo:501:mount.lustre.0 Request processed in 194us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.709610:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587099.709763:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587099.709812:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587099.709880:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.711098:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587099.715118:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127543936 00000100:00100000:1.0:1788587099.715138:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127543936 00000100:00100000:1.0:1788587099.715593:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587099.715605:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+9:17170:x1875469127543936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587099.716629:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+9:17170:x1875469127543936:12345-0@lo:503:mount.lustre.0 Request processed in 1023us (6744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.716647:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587099.716768:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127543936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587099.719710:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17209:1875469127544064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587099.719809:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.719907:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad660840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587099.720211:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127544064 00000100:00100000:0.0:1788587099.720219:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127544064 00000100:00100000:1.0:1788587099.720484:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587099.720496:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+9:17209:x1875469127544064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587099.721170:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+9:17209:x1875469127544064:12345-0@lo:502:llog_process_th.0 Request processed in 676us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.721180:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587099.722998:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17209:1875469127544064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587099.723043:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587099.723056:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.723058:0:17209:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788587099.723062:0:17209:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788587099.723066:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587099.723083:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f5baf193380) 00000020:00000080:3.0:1788587099.723100:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788587099.723105:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788587099.723182:0:17209:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788587099.723188:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda996 00000020:00000080:3.0:1788587099.723404:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788587099.723408:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587099.723412:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.723584:0:17209:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788587099.723589:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587099.723595:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.723596:0:17209:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788587099.723599:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587099.723606:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f5baf190000) 00000020:00000080:3.0:1788587099.723616:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788587099.723620:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788587099.723622:0:17209:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788587099.723636:0:17209:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788587099.723643:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788587099.723694:0:17209:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a8450b800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788587099.723707:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f5b86d53380) 00000020:00000080:3.0:1788587099.723715:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788587099.723781:0:17209:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788587099.723787:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fda9ab 00000020:00000080:3.0:1788587099.724158:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788587099.724165:0:17209:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788587099.724170:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xfbc93bbea5fda9b2 00080000:01000000:3.0:1788587099.724175:0:17209:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788587099.724178:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda9b9 00010000:00010000:3.0:1788587099.815547:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788587099.817589:0:17209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788587099.818085:0:17209:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788587099.818565:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f5b86d54d40) 00000020:00000080:3.0:1788587099.818583:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788587099.818647:0:17209:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788587099.818654:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda9c7 00000020:00000080:3.0:1788587099.823549:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788587099.825995:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xfbc93bbea5fda9ce 00000020:00000080:3.0:1788587099.826511:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788587099.826522:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587099.826528:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.826530:0:17209:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788587099.826533:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587099.826536:0:17209:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788587099.826538:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587099.826540:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587099.826541:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587099.826544:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.826545:0:17209:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587099.826548:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587099.826560:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.826561:0:17209:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788587099.826566:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788587099.826604:0:17209:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788587099.826619:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587099.826622:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.826623:0:17209:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788587099.826626:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587099.826629:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587099.826630:0:17209:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788587099.826633:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587099.826638:0:17209:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:00000080:3.0:1788587099.826662:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587099.826675:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f5b86d519c0) 00000020:00000080:3.0:1788587099.826687:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788587099.826691:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587099.826907:0:17209:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788587099.826915:0:17209:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788587099.826922:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda9dc 00010000:00080000:3.0:1788587099.826952:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5baaa5a800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:0.0:1788587099.840608:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788587099.846790:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587099.846805:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788587099.846848:0:17209:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788587099.846878:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fda9e3 00000100:00080000:1.0:1788587099.846889:0:17209:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587099.846895:0:17209:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f5baaa5a800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587099.846931:0:17209:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e37100 x1875469127544192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587099.846958:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788587099.847046:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127544192:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587099.847139:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788587099.847386:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587099.847390:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587099.847391:0:17209:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788587099.847395:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587099.847397:0:17209:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788587099.847398:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587099.847400:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587099.847401:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587099.847404:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587099.847405:0:17209:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587099.847408:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587099.847412:0:17209:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788587099.847438:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587099.847445:0:17209:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788587099.847449:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587099.847453:0:17209:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:1.0:1788587099.847473:0:17209:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788587099.847475:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587099.847487:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f5a83340000) 00000020:00000080:1.0:1788587099.847498:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788587099.847503:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587099.847573:0:17209:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788587099.847580:0:17209:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788587099.847586:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fda9f1 00010000:00080000:1.0:1788587099.847614:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bb4f7b000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788587099.847824:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788587099.848770:0:17209:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788587099.848964:0:17209:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788587099.855178:0:17209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587099.856029:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127544192 00000100:00100000:3.0:1788587099.856040:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127544192 00000100:00100000:3.0:1788587099.856085:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587099.856094:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875469127544192:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788587099.856113:0:17196:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:1.0:1788587099.857965:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788587099.871061:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788587099.875859:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587099.875866:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788587099.876607:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587099.876619:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788587099.876653:0:17209:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788587099.876674:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fda9f8 00000100:00080000:2.0:1788587099.876685:0:17209:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587099.876692:0:17209:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f5bb4f7b000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587099.876726:0:17209:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84520e00 x1875469127544320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587099.876761:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788587099.876811:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587099.876815:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.876817:0:17209:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788587099.876820:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587099.876823:0:17209:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788587099.876824:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587099.876826:0:17209:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587099.876827:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587099.876829:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.876831:0:17209:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587099.876834:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587099.876837:0:17209:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788587099.876841:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.876842:0:17209:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788587099.876845:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587099.876867:0:17209:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:2.0:1788587099.876893:0:17209:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788587099.876896:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587099.876908:0:17209:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f5a824319c0) 00000020:00000080:2.0:1788587099.876920:0:17209:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788587099.876925:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587099.876990:0:17209:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788587099.876996:0:17209:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788587099.877001:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xfbc93bbea5fdaa06 00010000:00080000:2.0:1788587099.877030:0:17209:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bb4cfe000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:2.0:1788587099.877234:0:17209:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788587099.877297:0:17209:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788587099.877312:0:17209:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788587099.878842:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127544320:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587099.878916:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127544320 offset 0 length 520: 4 00000040:00080000:2.0:1788587099.879937:0:17209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587099.880306:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788587099.880714:0:17209:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788587099.885244:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875469127544192:12345-0@lo:38:llog_process_th.0 Request processed in 29141us (38096us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587099.885262:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788587099.887080:0:17217:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587099.887087:0:17217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00080000:3.0:1788587099.888871:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587099.888881:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587099.888886:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127544192:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788587099.889247:0:17209:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587099.889261:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788587099.889300:0:17209:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788587099.889318:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fdaa0d 00000100:00080000:2.0:1788587099.889326:0:17209:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587099.889331:0:17209:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f5bb4cfe000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587099.889363:0:17209:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84523480 x1875469127544448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587099.889390:0:17209:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788587099.889466:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587099.889470:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.889472:0:17209:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788587099.889475:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587099.889479:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.889486:0:17209:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788587099.889490:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587099.889492:0:17209:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788587099.889494:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587099.889496:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.889497:0:17209:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788587099.889500:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587099.889502:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.889503:0:17209:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587099.889506:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788587099.889538:0:17209:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17209:1875469127544576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587099.889614:0:17209:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.889652:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127544576 00000100:00100000:2.0:1788587099.889658:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127544576 00000100:00100000:2.0:1788587099.889698:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587099.889707:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+9:17209:x1875469127544576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587099.889828:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+9:17209:x1875469127544576:12345-0@lo:502:llog_process_th.0 Request processed in 121us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.889836:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587099.889891:0:17209:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.889907:0:17209:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17209:1875469127544576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587099.889951:0:17209:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587099.889955:0:17209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.889957:0:17209:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788587099.889961:0:17209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788587099.890011:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788587099.890027:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788587099.890043:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda988 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890063:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1a000/0xfbc93bbea5fda981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda988 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587099.890071:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5a8450b800 from 1 10000000:01000000:2.0:1788587099.890074:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587099.890099:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890106:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890115:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.890129:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127544704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587099.890155:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.890169:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.890191:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127544704 00000100:00100000:2.0:1788587099.890195:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127544704 00000100:00100000:2.0:1788587099.890216:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587099.890223:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+9:17170:x1875469127544704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587099.890231:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587099.890244:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa14 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890263:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890283:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890291:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71c00, rc 0) 00000100:00100000:2.0:1788587099.890318:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+10:17170:x1875469127544704:12345-0@lo:101:mount.lustre.0 Request processed in 96us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.890348:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587099.890378:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127544704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587099.890395:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.890403:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.890961:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127544832:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788587099.890998:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.891025:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.891046:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127544832 00000100:00100000:2.0:1788587099.891050:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127544832 00000100:00100000:2.0:1788587099.891075:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587099.891081:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+10:17170:x1875469127544832:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788587099.891096:0:17185:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788587099.891102:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788587099.891161:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+10:17170:x1875469127544832:12345-0@lo:256:mount.lustre.0 Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.891169:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587099.891267:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127544832:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788587099.892351:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127544448:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788587099.892398:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127544448 offset 0 length 520: 4 10000000:01000000:2.0:1788587099.897778:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587099.897804:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.897817:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587099.897826:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a8450b800 from 1 10000000:01000000:2.0:1788587099.897829:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587099.897877:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.897885:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.897895:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.897920:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127544960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587099.897982:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.898081:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127544960 00000100:00100000:3.0:1788587099.898088:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127544960 00000100:00100000:2.0:1788587099.898984:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.900391:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587099.900468:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+10:17170:x1875469127544960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587099.900490:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587099.900516:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa22 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.900546:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.900558:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.900567:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1aa00, rc 0) 00000100:00100000:3.0:1788587099.900637:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+11:17170:x1875469127544960:12345-0@lo:101:mount.lustre.0 Request processed in 235us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.900644:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587099.900779:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127544960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587099.900798:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.900807:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.900955:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587099.900989:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.901026:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.901078:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545088 00000100:00100000:3.0:1788587099.901084:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545088 00000100:00100000:3.0:1788587099.901142:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587099.901149:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17170:x1875469127545088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587099.901288:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17170:x1875469127545088:12345-0@lo:501:mount.lustre.0 Request processed in 140us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.901294:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587099.901717:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587099.901761:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587099.901806:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.901933:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.901993:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545216 00000100:00100000:3.0:1788587099.901998:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545216 00000100:00100000:3.0:1788587099.902039:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587099.902046:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17170:x1875469127545216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587099.902280:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17170:x1875469127545216:12345-0@lo:503:mount.lustre.0 Request processed in 234us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.902288:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587099.902374:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587099.902819:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17219:1875469127545344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587099.902934:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.903003:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbace40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.903035:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545344 00000100:00100000:2.0:1788587099.903040:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545344 00000100:00100000:2.0:1788587099.903103:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587099.903111:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+11:17219:x1875469127545344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587099.903928:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+11:17219:x1875469127545344:12345-0@lo:502:llog_process_th.0 Request processed in 816us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.903936:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587099.904024:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17219:1875469127545344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788587099.904052:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587099.904060:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904062:0:17219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788587099.904068:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5a8450b800 00000020:00000080:0.0:1788587099.904071:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587099.904077:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587099.904079:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904080:0:17219:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788587099.904082:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587099.904084:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904090:0:17219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788587099.904094:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5a8450b800 00000020:00000080:0.0:1788587099.904095:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587099.904159:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587099.904162:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904163:0:17219:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788587099.904165:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587099.904167:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904168:0:17219:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587099.904171:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5a8450b800 00000020:00000080:0.0:1788587099.904173:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587099.904189:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587099.904191:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904192:0:17219:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587099.904194:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587099.904208:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587099.904209:0:17219:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788587099.904213:0:17219:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5a8450b800 00000020:00000080:0.0:1788587099.904215:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788587099.904251:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17219:1875469127545472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587099.904284:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.910947:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545472 00000100:00100000:3.0:1788587099.910962:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545472 00000100:00100000:3.0:1788587099.911016:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587099.911026:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17219:x1875469127545472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587099.911187:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17219:x1875469127545472:12345-0@lo:502:llog_process_th.0 Request processed in 161us (6900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.911212:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587099.914517:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a82616540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.914561:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17219:1875469127545472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587099.914601:0:17219:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587099.914610:0:17219:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587099.914612:0:17219:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788587099.914617:0:17219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788587099.915042:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788587099.915064:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587099.915087:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.915098:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587099.915148:0:17170:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788587099.915152:0:17170:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5a8450b800 10000000:01000000:0.0:1788587099.915155:0:17170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5a8450b800 10000000:01000000:0.0:1788587099.915165:0:17170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587099.915172:0:17170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5a8450b800 from 1 10000000:01000000:0.0:1788587099.915174:0:17170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587099.915945:0:17170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.915958:0:17170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.915970:0:17170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.915993:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587099.916059:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.916100:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a82616900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.917987:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545600 00000100:00100000:3.0:1788587099.918001:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545600 00000100:00100000:3.0:1788587099.918057:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587099.918067:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+11:17170:x1875469127545600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587099.918084:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587099.918101:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1a800/0xfbc93bbea5fdaa37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa30 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.918127:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1a800/0xfbc93bbea5fdaa37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa30 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.918137:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1a800/0xfbc93bbea5fdaa37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa30 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.918155:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1a800, rc 0) 00000100:00100000:3.0:1788587099.919139:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127545600:12345-0@lo:101:mount.lustre.0 Request processed in 1069us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.919148:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587099.920065:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587099.920092:0:17170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa37 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.920104:0:17170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa37 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.921300:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587099.921368:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587099.921433:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b922529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587099.921538:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545728 00000100:00100000:0.0:1788587099.921546:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545728 00000100:00100000:0.0:1788587099.923287:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587099.923306:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127545728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587099.923485:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127545728:12345-0@lo:501:mount.lustre.0 Request processed in 185us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.923492:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587099.923909:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587099.923958:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587099.924005:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587099.927434:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b922529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.927501:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545856 00000100:00100000:2.0:1788587099.927510:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545856 00000100:00100000:2.0:1788587099.927555:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587099.927565:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127545856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587099.927709:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127545856:12345-0@lo:503:mount.lustre.0 Request processed in 144us (3701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.927716:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587099.928677:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127545856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587099.932802:0:17224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17224:1875469127545984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587099.932943:0:17224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587099.932985:0:17224:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b922529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.933039:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127545984 00000100:00100000:2.0:1788587099.933047:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127545984 00000100:00100000:2.0:1788587099.933093:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587099.933103:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17224:x1875469127545984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587099.933239:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17224:x1875469127545984:12345-0@lo:502:llog_process_th.0 Request processed in 137us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.933247:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587099.933368:0:17224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17224:1875469127545984:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788587099.933456:0:17224:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788587099.933476:0:17224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f5a833419c0) 00000020:00000080:1.0:1788587099.933496:0:17224:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788587099.933585:0:17224:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a8450b800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788587099.933590:0:17224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5a8450b800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788587099.933593:0:17224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5a8450b800 4 00010000:00080000:1.0:1788587099.933631:0:17224:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5b8a4ca000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788587099.935788:0:17224:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788587099.936108:0:17224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788587099.936149:0:17224:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587099.936163:0:17224:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xfbc93bbea5fdaa45 00000100:00080000:1.0:1788587099.936173:0:17224:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587099.936178:0:17224:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f5b8a4ca000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587099.936216:0:17224:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e34000 x1875469127546112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587099.936245:0:17224:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788587099.936799:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127546112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587099.936879:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.936943:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546112 00000100:00100000:3.0:1788587099.936949:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546112 00000100:00100000:3.0:1788587099.936975:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587099.936981:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127546112:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587099.937023:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127546112:12345-0@lo:38:llog_process_th.0 Request processed in 40us (143us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788587099.937029:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587099.937061:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587099.937069:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5b8a4ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587099.937072:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788587099.937075:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127546112:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587099.937698:0:17224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17224:1875469127546240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587099.937739:0:17224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.937775:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546240 00000100:00100000:0.0:1788587099.937779:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546240 00000100:00100000:0.0:1788587099.937806:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587099.937812:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:17224:x1875469127546240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587099.937966:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:17224:x1875469127546240:12345-0@lo:502:llog_process_th.0 Request processed in 154us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.937974:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587099.938004:0:17224:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a826163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587099.938016:0:17224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17224:1875469127546240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587099.938044:0:17224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17224:1875469127546368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587099.938069:0:17224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.938079:0:17224:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a826163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.938721:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546368 00000100:00100000:3.0:1788587099.938727:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546368 00000100:00100000:3.0:1788587099.938772:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587099.938779:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17224:x1875469127546368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587099.938917:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17224:x1875469127546368:12345-0@lo:502:llog_process_th.0 Request processed in 137us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.938923:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587099.938965:0:17224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bf956867-663d-4ecf-b775-8366b2c643ae:17224:1875469127546368:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788587099.938984:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788587099.939959:0:17170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788587099.939988:0:17170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788587099.940010:0:17170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa37 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.940022:0:17170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5800/0xfbc93bbea5fdaa30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa37 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788587099.940075:0:17170:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788587099.940077:0:17170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587099.940078:0:17170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587099.940080:0:17170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587099.940081:0:17170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587099.940082:0:17170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587099.940083:0:17170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587099.940085:0:17170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587099.940087:0:17170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587099.940088:0:17170:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587099.940092:0:17170:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788587099.940095:0:17170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587099.940096:0:17170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587099.940097:0:17170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587099.940098:0:17170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587099.940099:0:17170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587099.940100:0:17170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587099.940101:0:17170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587099.940102:0:17170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587099.940103:0:17170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587099.940104:0:17170:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587099.940121:0:17170:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788587099.940135:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127546496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587099.940177:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.940963:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546496 00000100:00100000:0.0:1788587099.940973:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546496 00000100:00100000:0.0:1788587099.941013:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587099.941022:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127546496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587099.941049:0:17186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788587099.941062:0:17186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788587099.941708:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b92252480 going to sleep for 11 seconds 20000000:01000000:0.0:1788587099.950973:0:17186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788587099.950991:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788587099.951284:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17170:x1875469127546496:12345-0@lo:253:mount.lustre.0 Request processed in 10258us (11101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.951297:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:1.0:1788587099.951410:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788587099.951429:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788587099.951462:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.951479:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.951487:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.951524:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 11 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.951539:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 11 pid: 17184 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.951552:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127546624:0@lo:104: 00000100:00100000:1.0:1788587099.951598:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587099.951626:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b92252000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587099.951665:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17170:1875469127546496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587099.951676:0:17170:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788587099.951678:0:17170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587099.951680:0:17170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788587099.951682:0:17170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587099.951683:0:17170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587099.951684:0:17170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587099.951686:0:17170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587099.951687:0:17170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587099.951688:0:17170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788587099.951690:0:17170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587099.951691:0:17170:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788587099.951704:0:17170:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788587099.954127:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546624 00000100:00100000:0.0:1788587099.954142:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546624 00000100:00100000:0.0:1788587099.954190:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587099.954199:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127546624:12345-0@lo:104: 00010000:00010000:0.0:1788587099.954215:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.954304:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587099.954316:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127546624:12345-0@lo:104: Request processed in 118us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.954323:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788587099.954478:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587099.954485:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.954494:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587099.954498:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.954507:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587099.954515:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587099.954521:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587099.954552:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.954558:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587099.954578:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.954585:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70400/0xfbc93bbea5fdaa14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa1b expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.954599:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.954601:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587099.954602:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587099.954640:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587099.954652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127546752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587099.954691:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.954830:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127546624:0@lo:104: 00010000:00010000:2.0:1788587099.954850:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.957875:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546752 00000100:00100000:0.0:1788587099.957889:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546752 00010000:00010000:0.0:1788587099.957923:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 12 pid: 17184 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.957957:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587099.957965:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+12:3649:x1875469127546752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587099.957992:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587099.957998:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 12 pid: 17184 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958010:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 12 pid: 17184 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958027:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdaa1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa14 expref: 12 pid: 17184 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958044:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958052:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587099.958069:0:17176:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006640092s 00010000:00010000:0.0:1788587099.958073:0:17176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958079:0:17176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958092:0:17176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958098:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958103:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587099.958108:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958116:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958132:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958143:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587099.958208:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+11:3649:x1875469127546752:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.958215:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788587099.958241:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958249:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.958255:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8a466c00/0xfbc93bbea5fdaa4c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.958497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127546752:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788587099.988041:0:17170:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788587099.988368:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788587099.988774:0:17231:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788587099.989016:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788587099.989187:0:17231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788587099.989993:0:17230:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788587099.990006:0:17230:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:1.0:1788587099.990444:0:17232:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f5bb4e34a80 x1875469127546880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587099.990457:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000040:01000000:0.0:1788587099.990846:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788587099.990900:0:17170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788587099.991298:0:17170:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788587099.991305:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788587099.991341:0:17170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587099.992321:0:17170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788587099.992876:0:17170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788587099.992910:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788587099.996807:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587099.996888:0:17231:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788587099.997922:0:17170:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1788587099.998472:0:17170:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1788587100.000401:0:17170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788587100.002903:0:17170:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788587100.002944:0:17170:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacde4106f988 00100000:10000000:2.0:1788587100.002952:0:17170:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788587100.003538:0:17170:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587100.003556:0:17170:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587100.003571:0:17170:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788587100.003589:0:17170:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788587100.008149:0:17170:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788587100.008505:0:17170:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788587100.570988:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587100.756761:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587100.756769:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5a8450b800 from 7 10000000:01000000:2.0:1788587100.756775:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587100.756817:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587100.756836:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587100.757675:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587100.757707:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127547008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587100.757786:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587100.757840:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587100.757982:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547008 00000100:00100000:0.0:1788587100.757990:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547008 00000100:00100000:0.0:1788587100.758038:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587100.758046:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+11:17188:x1875469127547008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587100.758059:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587100.758072:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa53 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587100.758095:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587100.758104:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587100.758112:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5a00, rc 0) 00000100:00100000:0.0:1788587100.758146:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:17188:x1875469127547008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587100.758153:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587100.758224:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127547008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587100.758238:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587100.758247:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587100.758300:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127547136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788587100.758329:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587100.758386:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587100.764931:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547136 00000100:00100000:0.0:1788587100.764950:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547136 00000100:00100000:3.0:1788587100.765183:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587100.765194:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17188:x1875469127547136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788587100.765220:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587100.765235:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587100.765239:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788587100.765370:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17188:x1875469127547136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587100.765389:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587100.766834:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127547136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788587100.767072:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587100.767082:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587100.767094:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587100.950905:0:17226:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587100.950914:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587100.953301:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788587100.953316:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587101.013531:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788587101.589677:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587101.982394:0:17226:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587101.982404:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587101.982555:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788587101.982591:0:17226:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587101.982724:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:2.0:1788587102.039604:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788587102.618395:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587103.067149:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788587103.637957:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587104.086935:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788587104.660577:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587104.860343:0:17475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788587105.108797:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788587105.108804:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788587105.108807:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587105.108814:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:3.0:1788587105.108827:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788587105.108835:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f5baaa5a800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587105.108843:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127547264:0@lo:400:kworker.0 00000100:00100000:3.0:1788587105.108861:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a8310bb80 x1875469127547392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587105.108915:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587105.109033:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587105.109037:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587105.109040:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587105.109043:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587105.109046:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788587105.109048:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788587105.109051:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5b8a4ca000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587105.109056:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f5b8a4ca000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587105.109075:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83108700 x1875469127547520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587105.109108:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127547392:0@lo:38:kworker.0 00000100:00100000:3.0:1788587105.109142:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587105.109170:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127547520:0@lo:38:kworker.0 00000100:00100000:0.0:1788587105.109178:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547264 00000100:00100000:0.0:1788587105.109187:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547264 00000100:00100000:0.0:1788587105.109238:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587105.109248:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:3649:x1875469127547264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587105.109294:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:3649:x1875469127547264:12345-0@lo:400:kworker.0 Request processed in 48us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587105.109301:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587105.109338:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547392 00000100:00100000:0.0:1788587105.109342:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547392 00000100:00100000:0.0:1788587105.109359:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587105.109363:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875469127547392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788587105.109378:0:17197:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587105.109566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587105.109617:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547520 00000100:00100000:3.0:1788587105.109621:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547520 00000100:00100000:3.0:1788587105.109653:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587105.109658:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875469127547520:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788587105.109675:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788587105.109721:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xfbc93bbea5fdaa61 00000004:00100000:3.0:1788587105.109745:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788587105.109755:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000100:00080000:3.0:1788587105.109929:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8f5bb05d6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587105.109967:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875469127547520:12345-0@lo:38:kworker.0 Request processed in 308us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587105.109974:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587105.110009:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f5a83108700 x1875469127547520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587105.110022:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788587105.110028:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788587105.110032:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587105.110034:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5b8a4ca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587105.110039:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875469127547520:0@lo:38:kworker.0 00000100:00100000:1.0:1788587105.114301:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127547264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587105.134327:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875469127547392:12345-0@lo:38:kworker.0 Request processed in 24956us (25177us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587105.134341:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788587105.135176:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587105.135185:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587105.135189:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127547392:0@lo:38:kworker.0 00010000:00010000:2.0:1788587105.686745:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788587105.746498:0:17527:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587105.746701:0:17527:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788587106.134634:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000020:00000004:2.0:1788587106.617810:0:17577:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788587106.617996:0:17577:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788587106.708619:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587107.159991:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788587107.735620:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587108.181451:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788587108.756774:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587109.205560:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788587109.206443:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587099/real 1788587099] req@ffff8f5a84523480 x1875469127544448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587109.206474:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84523480 x1875469127544448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587109.206483:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587099/real 1788587099] req@ffff8f5a84520e00 x1875469127544320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587109.206495:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84520e00 x1875469127544320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587109.206510:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587109.206526:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587109.206529:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127544448:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788587109.206535:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587109.206540:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587109.206552:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127544320:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788587109.210310:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788587109.210317:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788587109.210321:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587109.210328:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:1.0:1788587109.210334:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587109.210341:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f5baaa5a800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587109.210363:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e36d80 x1875469127547776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587109.210381:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587109.210384:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788587109.210386:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587109.210389:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1788587109.210392:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788587109.210412:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f5bb4f7b000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587109.210867:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e36300 x1875469127547904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587109.210878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587109.210882:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788587109.210884:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587109.210887:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1788587109.210890:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788587109.210894:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f5bb4cfe000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587109.210907:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e37800 x1875469127548032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587109.210976:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127548160:0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.211045:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587109.211099:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587109.211106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127547648:0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.212253:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587109.212322:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127547776:0@lo:38:kworker.0 00000100:00100000:1.0:1788587109.212366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587109.212386:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127547904:0@lo:8:kworker.0 00000400:00000100:1.0:1788587109.212410:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127547904 offset 0 length 520: 4 00000100:00100000:0.0:1788587109.213246:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547648 00000100:00100000:0.0:1788587109.213256:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547648 00000100:00100000:0.0:1788587109.213301:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587109.213309:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:3647:x1875469127547648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587109.213367:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:3647:x1875469127547648:12345-0@lo:400:kworker.0 Request processed in 59us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587109.213385:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587109.214101:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127548032:0@lo:8:kworker.0 00000100:00100000:0.0:1788587109.214205:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127547776 00000100:00100000:0.0:1788587109.214212:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127547776 00000100:00100000:0.0:1788587109.214239:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587109.214244:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875469127547776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788587109.214261:0:17196:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000100:1.0:1788587109.214836:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127548032 offset 0 length 520: 4 00000100:00100000:1.0:1788587109.214903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127547648:0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.216306:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548160 00000100:00100000:1.0:1788587109.216330:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548160 00000100:00100000:1.0:1788587109.216380:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587109.216389:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127548160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.216473:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127548160:12345-0@lo:400:kworker.0 Request processed in 85us (5426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587109.216479:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788587109.216529:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f5bb4e35f80 x1875469127548160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587109.216544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127548160:0@lo:400:kworker.0 00000100:00100000:0.0:1788587109.243450:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875469127547776:12345-0@lo:38:kworker.0 Request processed in 29196us (31074us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587109.243465:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788587109.243517:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587109.243524:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788587109.243528:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127547776:0@lo:38:kworker.0 00010000:00010000:3.0:1788587109.780581:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587110.231382:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788587110.808867:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587111.190195:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587111.255014:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788587111.829842:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587112.277065:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788587112.860170:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587112.990293:0:17922:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587112.990297:0:17922:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788587112.990299:0:17922:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788587112.992595:0:17922:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f5bb05d5000 00000020:01000004:3.0:1788587112.992621:0:17922:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788587112.992633:0:17922:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788587112.992668:0:17922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f5b86d50000) 00000020:00000080:3.0:1788587112.992687:0:17922:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788587113.060112:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.060359:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788587113.064074:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788587113.064400:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788587113.064819:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788587113.065298:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788587113.065620:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788587113.065833:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788587113.066361:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788587113.066599:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788587113.066924:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788587113.067119:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788587113.067307:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788587113.067641:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788587113.068125:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.068908:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.069149:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.069763:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.069980:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.070178:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.070685:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.070909:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.071101:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.071278:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.071814:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.075213:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.075640:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.075937:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.076176:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.076377:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.076778:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.077033:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.077230:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.077515:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.077716:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.078766:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788587113.079057:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.079572:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.081579:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.081988:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788587113.082185:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788587113.082663:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788587113.082903:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788587113.083120:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788587113.083299:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788587113.083546:0:17922:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00080000:01000000:2.0:1788587113.084208:0:17922:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788587113.084807:0:17922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788587113.084819:0:17922:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587113.084836:0:17922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fdaa6f 00000020:01000004:2.0:1788587113.084843:0:17922:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788587113.084864:0:17922:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587113.084867:0:17922:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587113.084873:0:17922:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788587113.084901:0:17922:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788587113.084905:0:17922:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788587113.089273:0:17922:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788587113.089318:0:17922:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.101@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788587113.089322:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788587113.089324:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788587113.089325:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587113.089326:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587113.089328:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587113.089329:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587113.089330:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587113.089331:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587113.089333:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587113.089337:0:17922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788587113.089339:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587113.089341:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788587113.089342:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587113.089343:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587113.089344:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587113.089351:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587113.089352:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587113.089353:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587113.089354:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587113.089385:0:17922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788587113.089405:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587113.089521:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.089579:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.089751:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548288 00000100:00100000:3.0:1788587113.089759:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548288 00000100:00100000:3.0:1788587113.089823:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587113.089834:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17922:x1875469127548288:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587113.089863:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788587113.089866:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788587113.089874:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788587113.090219:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+12:17922:x1875469127548288:12345-0@lo:253:mount.lustre.0 Request processed in 387us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.090229:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587113.090305:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548288:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587113.090316:0:17922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788587113.090318:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587113.090319:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788587113.090320:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587113.090321:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587113.090322:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587113.090323:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587113.090323:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587113.090324:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587113.090325:0:17922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587113.090343:0:17922:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5bb05d5000 from lustre-MDT0001 10000000:01000000:2.0:1788587113.090366:0:17922:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788587113.090369:0:17922:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788587113.090376:0:17922:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f5a83343380 local copy 00010000:00010000:2.0:1788587113.090386:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.090631:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.090674:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.090740:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.090878:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548416 00000100:00100000:0.0:1788587113.090884:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548416 00000100:00100000:0.0:1788587113.090957:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587113.090966:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17922:x1875469127548416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587113.091038:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+12:17922:x1875469127548416:12345-0@lo:501:mount.lustre.0 Request processed in 72us (363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587113.091045:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587113.091098:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548416:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788587113.091110:0:17922:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788587113.091127:0:17922:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788587113.091140:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091149:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.091175:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5bb05d5000 10000000:01000000:2.0:1788587113.091180:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788587113.091184:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f5a83343380 10000000:01000000:2.0:1788587113.091187:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788587113.091190:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f5a83343380 from 1 10000000:01000000:2.0:1788587113.091193:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788587113.091215:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091224:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091232:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.091245:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587113.091269:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.091326:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.091385:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548544 00000100:00100000:1.0:1788587113.091390:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548544 00000100:00100000:1.0:1788587113.091440:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587113.091447:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+12:17922:x1875469127548544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587113.091456:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587113.091470:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a466800/0xfbc93bbea5fdaa7d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa76 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.091490:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a466800/0xfbc93bbea5fdaa7d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa76 expref: 13 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.091500:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a466800/0xfbc93bbea5fdaa7d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa76 expref: 13 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.091509:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466800, rc 0) 00000100:00100000:1.0:1788587113.091541:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+13:17922:x1875469127548544:12345-0@lo:101:mount.lustre.0 Request processed in 95us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.091547:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788587113.091639:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.091651:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa7d expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091671:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa7d expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.091691:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788587113.091710:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa7d expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091718:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71800/0xfbc93bbea5fdaa76 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa7d expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.091725:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f5bb05d5000 10000000:01000000:2.0:1788587113.091729:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788587113.091732:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f5bb05d5000 from 1 10000000:01000000:2.0:1788587113.091735:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788587113.091749:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091756:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.091772:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.091785:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587113.091811:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.091829:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.091989:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548672 00000100:00100000:1.0:1788587113.091995:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548672 00000100:00100000:1.0:1788587113.092014:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788587113.092020:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+13:17922:x1875469127548672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587113.092026:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587113.092033:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a467e00/0xfbc93bbea5fdaa8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa84 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.092045:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a467e00/0xfbc93bbea5fdaa8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa84 expref: 14 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.092053:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a467e00/0xfbc93bbea5fdaa8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa84 expref: 14 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.092058:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467e00, rc 0) 00000100:00100000:1.0:1788587113.092095:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+14:17922:x1875469127548672:12345-0@lo:101:mount.lustre.0 Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.092100:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587113.092168:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.092179:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa8b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.092186:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa8b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.092202:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788587113.092218:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa8b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.092225:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70600/0xfbc93bbea5fdaa84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa8b expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.092231:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788587113.092235:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587113.092240:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f5bb05d5000 10000000:01000000:2.0:1788587113.092243:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788587113.092246:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788587113.092248:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788587113.092260:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.092266:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.092273:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.092284:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587113.092308:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.092319:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.092366:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548800 00000100:00100000:1.0:1788587113.092369:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548800 00000100:00100000:1.0:1788587113.092387:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788587113.092393:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+14:17922:x1875469127548800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587113.092400:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587113.092442:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a467800/0xfbc93bbea5fdaa99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaa92 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.092456:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a467800/0xfbc93bbea5fdaa99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa92 expref: 15 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.092463:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a467800/0xfbc93bbea5fdaa99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa92 expref: 15 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.092477:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467800, rc 0) 00000100:00100000:1.0:1788587113.092507:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127548800:12345-0@lo:101:mount.lustre.0 Request processed in 114us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.092514:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587113.092599:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.092609:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa99 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.092624:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaa99 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587113.093892:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788587113.094591:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587113.098944:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788587113.099003:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788587113.099020:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788587113.099035:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788587113.099050:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788587113.099064:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788587113.099077:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788587113.099090:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788587113.099108:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788587113.099123:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788587113.099137:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788587113.099153:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788587113.099169:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788587113.099183:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788587113.099198:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788587113.099213:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788587113.099226:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788587113.099240:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788587113.099254:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788587113.099268:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788587113.099282:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788587113.099295:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788587113.099308:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788587113.099336:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788587113.099342:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788587113.099603:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.099696:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.099789:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.099887:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127548928 00000100:00100000:1.0:1788587113.099896:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127548928 00000100:00100000:1.0:1788587113.099993:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788587113.100004:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127548928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587113.100152:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127548928:12345-0@lo:501:mount.lustre.0 Request processed in 150us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.100159:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587113.100229:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127548928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.100261:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127549056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587113.100303:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.100625:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.100838:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549056 00000100:00100000:0.0:1788587113.100844:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549056 00000100:00100000:0.0:1788587113.100873:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587113.100881:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127549056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587113.101521:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127549056:12345-0@lo:503:mount.lustre.0 Request processed in 638us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.101538:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587113.101692:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127549056:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788587113.102130:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587113.102201:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127549184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.102245:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.102282:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.102548:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549184 00000100:00100000:0.0:1788587113.102554:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549184 00000100:00100000:0.0:1788587113.102581:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587113.102589:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127549184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587113.103240:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127549184:12345-0@lo:502:mount.lustre.0 Request processed in 649us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.103249:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587113.103385:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127549184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.103649:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788587113.103690:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788587113.103705:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788587113.103720:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788587113.103734:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788587113.103746:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788587113.103759:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788587113.103866:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788587113.103885:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788587113.103898:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788587113.103912:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788587113.103925:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788587113.103938:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788587113.103951:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788587113.103965:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788587113.103994:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788587113.104010:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788587113.104026:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788587113.104040:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788587113.104055:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788587113.104069:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788587113.104082:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788587113.104095:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788587113.104108:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788587113.104120:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788587113.104133:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788587113.104147:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788587113.104159:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788587113.104171:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788587113.104182:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788587113.104194:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788587113.104205:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788587113.104217:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788587113.104229:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788587113.104242:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788587113.104256:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788587113.104270:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788587113.104284:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788587113.104297:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788587113.104310:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788587113.104322:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788587113.104338:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788587113.104352:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788587113.104366:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788587113.104405:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127549312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.104599:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.104868:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b85edf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.104991:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549312 00000100:00100000:3.0:1788587113.105007:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549312 00000100:00100000:0.0:1788587113.105071:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587113.105082:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127549312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587113.105196:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127549312:12345-0@lo:502:mount.lustre.0 Request processed in 117us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.105204:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587113.105302:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127549312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.105356:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788587113.105366:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788587113.110278:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587113.110292:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.110295:0:17926:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788587113.110305:0:17926:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788587113.110308:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587113.110322:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f5a826e99c0) 00000020:00000080:0.0:1788587113.110346:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788587113.110353:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788587113.111000:0:17926:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788587113.111009:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fdaaa7 00000020:00000080:0.0:1788587113.111222:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788587113.111228:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587113.111232:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.111234:0:17926:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788587113.111238:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587113.111249:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.111250:0:17926:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788587113.111255:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587113.111332:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f5a826eb380) 00000020:00000080:0.0:1788587113.111346:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788587113.111352:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788587113.111354:0:17926:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788587113.111357:0:17926:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788587113.111366:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587113.111455:0:17926:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bb05d5000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788587113.111468:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f5a826ecd40) 00000020:00000080:0.0:1788587113.111477:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788587113.111528:0:17926:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788587113.111534:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdaabc 00000020:00000080:0.0:1788587113.111634:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788587113.111641:0:17926:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788587113.111645:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xfbc93bbea5fdaac3 00080000:01000000:0.0:1788587113.111651:0:17926:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788587113.111667:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fdaaca 00010000:00010000:0.0:1788587113.185093:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788587113.185556:0:17926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788587113.185945:0:17926:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788587113.186876:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788587113.186890:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587113.186895:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587113.186898:0:17926:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788587113.186902:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587113.186906:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587113.186908:0:17926:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788587113.186911:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587113.186917:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:00000080:1.0:1788587113.186943:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587113.186957:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f5a83344d40) 00000020:00000080:1.0:1788587113.186976:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788587113.186981:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587113.187053:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788587113.187060:0:17926:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788587113.187066:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fdaad8 00010000:00080000:1.0:1788587113.187097:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bbcb38000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:3.0:1788587113.189211:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788587113.198709:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788587113.198726:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788587113.198775:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788587113.198801:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdaadf 00000100:00080000:2.0:1788587113.198813:0:17926:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587113.198819:0:17926:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f5bbcb38000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587113.198857:0:17926:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84520e00 x1875469127549440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587113.198877:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788587113.198935:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127549440:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788587113.198939:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587113.198944:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.198946:0:17926:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788587113.198949:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587113.198952:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788587113.198953:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587113.198955:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587113.198957:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587113.198960:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.198962:0:17926:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587113.198964:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587113.198969:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.198971:0:17926:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788587113.198976:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788587113.199010:0:17926:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788587113.199011:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788587113.199024:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587113.199029:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.199030:0:17926:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788587113.199034:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587113.199043:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788587113.199046:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587113.199048:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587113.199050:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587113.199053:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.199055:0:17926:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587113.199057:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587113.199061:0:17926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788587113.199065:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.199067:0:17926:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788587113.199072:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587113.199077:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000100:00100000:0.0:1788587113.199094:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549440 00000020:01000000:2.0:1788587113.199098:0:17926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788587113.199102:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1788587113.199102:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549440 00000020:00000080:2.0:1788587113.199117:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f5a82433380) 00000020:00000080:2.0:1788587113.199132:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788587113.199137:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788587113.199146:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587113.199153:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875469127549440:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587113.199176:0:17197:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000004:00080000:2.0:1788587113.199197:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788587113.199204:0:17926:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788587113.199211:0:17197:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdaaed 00000020:00000080:2.0:1788587113.199213:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fdaaf4 00000004:00100000:0.0:1788587113.199231:0:17197:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:2.0:1788587113.199245:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bb4cff800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.101@tcp at head 00000001:00000004:0.0:1788587113.199246:0:17197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788587113.199506:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788587113.199796:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788587113.199801:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788587113.199803:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587113.199808:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1788587113.199812:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788587113.199816:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f5baaa5a800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587113.199837:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a8310bb80 x1875469127549568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587113.199852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587113.199855:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587113.199857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587113.199860:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587113.199897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127549696:0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.199936:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587113.199978:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549696 00000100:00100000:3.0:1788587113.199982:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549696 00000100:00100000:3.0:1788587113.200015:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587113.200022:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127549696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587113.200069:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127549696:12345-0@lo:400:kworker.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.200076:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587113.200110:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f5a83108700 x1875469127549696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587113.200134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127549696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587113.200703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127549568:0@lo:38:kworker.0 00000100:00100000:0.0:1788587113.200741:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587113.200776:0:17196:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788587113.200784:0:17196:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788587113.204989:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549568 00000100:00100000:0.0:1788587113.205007:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549568 00000100:00100000:3.0:1788587113.205473:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587113.205483:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875469127549568:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788587113.205593:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875469127549568:12345-0@lo:38:kworker.0 Request processed in 110us (4852us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788587113.205601:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587113.205958:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587113.205967:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587113.205972:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788587113.205975:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127549568:0@lo:38:kworker.0 00000040:01000000:2.0:1788587113.206533:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788587113.206981:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788587113.210898:0:17197:0:(import.c:65:import_set_state_nolock()) ffff8f5bbc98c800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788587113.211708:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587113.212028:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788587113.212178:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1788587113.212323:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875469127549440:12345-0@lo:38:llog_process_th.0 Request processed in 13166us (13310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.212347:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587113.217893:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587113.217909:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788587113.217919:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788587113.217926:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788587113.217929:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbcb38000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788587113.217950:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127549440:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788587113.218293:0:17932:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788587113.218299:0:17932:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788587113.218490:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587113.218506:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127549824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587113.218578:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587113.218616:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127549824 00000100:00100000:0.0:1788587113.218622:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127549824 00000100:00100000:0.0:1788587113.218675:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587113.218684:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875469127549824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587113.218714:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788587113.218764:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875469127549824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.218771:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587113.218910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127549824:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788587113.220938:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587113.220952:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587113.220997:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788587113.221019:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdaafb 00000100:00080000:3.0:1788587113.221029:0:17926:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587113.221035:0:17926:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f5bb4cff800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587113.221069:0:17926:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83108700 x1875469127549952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587113.221088:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788587113.221168:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127549952:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587113.221217:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127549952 offset 0 length 520: 4 00000020:01000000:3.0:1788587113.222551:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587113.222558:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587113.222560:0:17926:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788587113.222564:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587113.222567:0:17926:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788587113.222579:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587113.222582:0:17926:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587113.222583:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587113.222586:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587113.222587:0:17926:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587113.222590:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587113.222594:0:17926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788587113.222597:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587113.222598:0:17926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788587113.222601:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587113.222605:0:17926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.101@tcp to nid 0x20000c0a8cb65 (192.168.203.101@tcp) 00000020:01000000:3.0:1788587113.222628:0:17926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788587113.222630:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587113.222645:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f5ba7ab0000) 00000020:00000080:3.0:1788587113.222677:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788587113.222682:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587113.222757:0:17926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788587113.222853:0:17926:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788587113.222863:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xfbc93bbea5fdab09 00010000:00080000:3.0:1788587113.222997:0:17926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5bbfa54800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:3.0:1788587113.223203:0:17926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788587113.223261:0:17926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788587113.223275:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788587113.225858:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587113.225868:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587113.225871:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587113.225875:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788587113.227071:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587113.227275:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788587113.227404:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788587113.228244:0:17934:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788587113.228250:0:17934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788587113.229177:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788587113.229189:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788587113.229227:0:17926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788587113.229247:0:17926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdab10 00000100:00080000:0.0:1788587113.229256:0:17926:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587113.229263:0:17926:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f5bbfa54800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587113.229295:0:17926:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84467b80 x1875469127550080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587113.229324:0:17926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788587113.229441:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127550080:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788587113.229508:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127550080 offset 0 length 520: 4 00000020:01000000:0.0:1788587113.229702:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587113.229706:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.229708:0:17926:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788587113.229711:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587113.229714:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.229715:0:17926:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587113.229718:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587113.229720:0:17926:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587113.229722:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587113.229724:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.229725:0:17926:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788587113.229728:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587113.229730:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.229731:0:17926:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788587113.229735:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788587113.229758:0:17926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587113.229761:0:17926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587113.229762:0:17926:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788587113.229765:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1788587113.229922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587113.229928:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587113.229930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587113.229939:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788587113.229995:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788587113.230027:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788587113.230050:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa99 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.230062:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71000/0xfbc93bbea5fdaa92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaa99 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.230070:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5bb05d5000 from 1 10000000:01000000:2.0:1788587113.230073:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587113.230099:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.230106:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.230117:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.230135:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587113.230180:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.230213:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.230274:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550208 00000100:00100000:3.0:1788587113.230281:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550208 00000100:00100000:3.0:1788587113.230328:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587113.230337:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+15:17922:x1875469127550208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587113.230349:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587113.230361:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab17 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587113.230384:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 16 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587113.230394:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 16 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587113.230403:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1b200, rc 0) 00000100:00100000:3.0:1788587113.230481:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+16:17922:x1875469127550208:12345-0@lo:101:mount.lustre.0 Request processed in 145us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.230488:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587113.230633:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.230648:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.230669:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.231213:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550336:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788587113.231255:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.231293:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.231547:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550336 00000100:00100000:3.0:1788587113.231553:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550336 00000100:00100000:3.0:1788587113.231593:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587113.231601:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+16:17922:x1875469127550336:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788587113.231617:0:17185:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788587113.231633:0:17185:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587113.231637:0:17185:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788587113.231734:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+16:17922:x1875469127550336:12345-0@lo:256:mount.lustre.0 Request processed in 134us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.231751:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587113.231871:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550336:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788587113.232681:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587113.232732:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.232743:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.232752:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bb05d5000 from 1 10000000:01000000:2.0:1788587113.232755:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587113.232784:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.232793:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.232814:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.232835:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587113.232877:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.232914:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.232975:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550464 00000100:00100000:3.0:1788587113.232980:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550464 00000100:00100000:3.0:1788587113.233021:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587113.233029:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+16:17922:x1875469127550464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587113.233040:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587113.233050:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab25 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587113.233070:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587113.233080:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587113.233088:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1ba00, rc 0) 00000100:00100000:3.0:1788587113.233131:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550464:12345-0@lo:101:mount.lustre.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.233138:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587113.233213:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.233225:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.233233:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587113.233352:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587113.233380:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.233451:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.233472:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.233579:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550592 00000100:00100000:3.0:1788587113.233584:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550592 00000100:00100000:3.0:1788587113.233614:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587113.233621:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587113.233712:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550592:12345-0@lo:501:mount.lustre.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.233718:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587113.233792:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.233817:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587113.233853:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.233880:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587113.233930:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550720 00000100:00100000:3.0:1788587113.233940:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550720 00000100:00100000:3.0:1788587113.233969:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587113.233976:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587113.234047:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550720:12345-0@lo:503:mount.lustre.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587113.234053:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587113.234139:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788587113.234574:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587113.234643:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.234703:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.234720:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.234796:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550848 00000100:00100000:1.0:1788587113.234801:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550848 00000100:00100000:1.0:1788587113.234833:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587113.234841:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587113.234923:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550848:12345-0@lo:502:mount.lustre.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.234930:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587113.235040:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.235208:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788587113.235234:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788587113.235249:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788587113.235263:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788587113.235277:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788587113.235292:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788587113.235306:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788587113.235334:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788587113.235350:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788587113.235364:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788587113.235378:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788587113.235401:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.238220:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.238266:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.238370:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127550976 00000100:00100000:1.0:1788587113.238379:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127550976 00000100:00100000:1.0:1788587113.238453:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587113.238462:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587113.238580:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127550976:12345-0@lo:502:mount.lustre.0 Request processed in 117us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.238587:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587113.239031:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127550976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.239116:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1788587113.239130:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788587113.239813:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587113.239822:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.239825:0:17936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788587113.239831:0:17936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5bb05d5000 00000020:00000080:2.0:1788587113.239834:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587113.239842:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587113.239844:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.239846:0:17936:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788587113.239848:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587113.239858:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.239860:0:17936:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788587113.239863:0:17936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5bb05d5000 00000020:00000080:2.0:1788587113.239865:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587113.240019:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587113.240023:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.240024:0:17936:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788587113.240027:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587113.240029:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.240031:0:17936:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587113.240035:0:17936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5bb05d5000 00000020:00000080:2.0:1788587113.240037:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587113.243545:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587113.243556:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.243559:0:17936:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587113.243563:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587113.243567:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.243568:0:17936:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788587113.243573:0:17936:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5bb05d5000 00000020:00000080:2.0:1788587113.243575:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587113.243632:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587113.243637:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587113.243638:0:17936:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788587113.243641:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788587113.244532:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788587113.244567:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587113.244645:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.244668:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.244722:0:17922:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788587113.244731:0:17922:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5bb05d5000 10000000:01000000:2.0:1788587113.244734:0:17922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5bb05d5000 10000000:01000000:2.0:1788587113.244738:0:17922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587113.244744:0:17922:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5bb05d5000 from 1 10000000:01000000:2.0:1788587113.244747:0:17922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587113.244782:0:17922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.244790:0:17922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.244800:0:17922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.244825:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587113.244887:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.244925:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551104 00000100:00100000:2.0:1788587113.244933:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551104 00000100:00100000:2.0:1788587113.244983:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587113.244992:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+17:17922:x1875469127551104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.245004:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587113.245016:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa70a00/0xfbc93bbea5fdab3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab33 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.245039:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa70a00/0xfbc93bbea5fdab3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab33 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.245050:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa70a00/0xfbc93bbea5fdab3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab33 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.245069:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70a00, rc 0) 00000100:00100000:2.0:1788587113.245103:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551104:12345-0@lo:101:mount.lustre.0 Request processed in 112us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.245110:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587113.245151:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587113.245170:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587113.245184:0:17922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab3a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.245193:0:17922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab3a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587113.261734:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788587113.262042:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587113.262243:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788587113.262269:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788587113.262283:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788587113.262297:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788587113.262308:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788587113.262321:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788587113.262334:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788587113.262347:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788587113.262359:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788587113.262370:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788587113.262382:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788587113.262393:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788587113.262443:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788587113.262459:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788587113.262480:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788587113.262492:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788587113.262503:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788587113.262515:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788587113.262527:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788587113.262540:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788587113.262553:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788587113.262567:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788587113.262581:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788587113.262596:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788587113.262610:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788587113.262623:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788587113.262637:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788587113.262650:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788587113.262695:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788587113.262702:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788587113.262779:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.262843:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.262887:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587113.262919:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551232 00000100:00100000:2.0:1788587113.262925:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551232 00000100:00100000:2.0:1788587113.262963:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587113.262971:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.263074:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551232:12345-0@lo:501:mount.lustre.0 Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.263082:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587113.263127:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587113.263155:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587113.263190:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.263219:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587113.263662:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551360 00000100:00100000:1.0:1788587113.263667:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551360 00000100:00100000:1.0:1788587113.263698:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587113.263705:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587113.263787:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551360:12345-0@lo:503:mount.lustre.0 Request processed in 81us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587113.263794:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587113.263943:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788587113.264287:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587113.264347:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.264386:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.264442:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587113.264459:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551488 00000100:00100000:2.0:1788587113.264464:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551488 00000100:00100000:2.0:1788587113.264491:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587113.264498:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.264573:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551488:12345-0@lo:502:mount.lustre.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.264581:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587113.264622:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.264776:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788587113.264800:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788587113.264815:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788587113.264829:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788587113.264843:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788587113.264856:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788587113.264868:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788587113.264883:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788587113.264896:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788587113.264907:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788587113.264920:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788587113.264932:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788587113.264944:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788587113.264972:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788587113.264994:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788587113.265007:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788587113.265019:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788587113.265030:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788587113.265042:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788587113.265053:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788587113.265065:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788587113.265076:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788587113.265088:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788587113.265100:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788587113.265114:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788587113.265127:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788587113.265141:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788587113.265156:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788587113.265170:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788587113.265196:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788587113.265214:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788587113.265229:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788587113.265244:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788587113.265259:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788587113.265274:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788587113.265288:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788587113.265301:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788587113.265313:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788587113.265324:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788587113.265335:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788587113.265347:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788587113.265358:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788587113.265370:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788587113.265382:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788587113.265394:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788587113.265439:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788587113.265456:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788587113.265477:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788587113.265511:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.265555:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.265576:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587113.265599:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551616 00000100:00100000:2.0:1788587113.265604:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551616 00000100:00100000:2.0:1788587113.265631:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587113.265637:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.268228:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551616:12345-0@lo:502:mount.lustre.0 Request processed in 2582us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.268241:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587113.268321:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.269298:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788587113.269335:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788587113.269376:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.272850:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.272902:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551744 00000100:00100000:2.0:1788587113.272911:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551744 00000100:00100000:2.0:1788587113.272959:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587113.272968:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587113.273096:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127551744:12345-0@lo:502:mount.lustre.0 Request processed in 129us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.273104:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587113.273230:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587113.273253:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127551744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587113.273331:0:17922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788587113.273350:0:17922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788587113.285147:0:17941:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788587113.285166:0:17941:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f5ba7ab3380) 00000020:00000080:3.0:1788587113.285186:0:17941:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788587113.285273:0:17941:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5bb05d5000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788587113.285277:0:17941:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5bb05d5000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788587113.285280:0:17941:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5bb05d5000 3 00010000:00080000:3.0:1788587113.285319:0:17941:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5b88841800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.101@tcp at head 00010000:00010000:2.0:1788587113.299983:0:17941:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788587113.300179:0:17941:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788587113.300225:0:17941:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788587113.300237:0:17941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xfbc93bbea5fdab48 00000100:00080000:2.0:1788587113.300248:0:17941:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587113.300254:0:17941:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f5b88841800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587113.300287:0:17941:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84523480 x1875469127551872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587113.300317:0:17941:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788587113.300344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587113.300348:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587113.300351:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587113.300353:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587113.300483:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127551872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587113.300551:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.300893:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127551872 00000100:00100000:3.0:1788587113.300896:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788587113.300900:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127551872 00000100:00100000:2.0:1788587113.300942:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587113.300950:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875469127551872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788587113.300972:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1788587113.301004:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xfbc93bbea5fdab4f 00000004:00100000:2.0:1788587113.301019:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788587113.301047:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8f5a84598000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587113.301104:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875469127551872:12345-0@lo:38:llog_process_th.0 Request processed in 152us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.301112:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788587113.301143:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f5a84523480 x1875469127551872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587113.301154:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587113.301161:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788587113.301168:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788587113.301172:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587113.301174:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5b88841800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587113.301181:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875469127551872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788587113.306152:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788587113.310691:0:17922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788587113.310755:0:17922:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788587113.310776:0:17922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab3a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587113.310789:0:17922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71200/0xfbc93bbea5fdab33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab3a expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788587113.310846:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788587113.310848:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788587113.310850:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587113.310851:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587113.310852:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587113.310854:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587113.310855:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587113.310857:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587113.310858:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587113.310862:0:17922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788587113.310865:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587113.310866:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788587113.310984:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587113.310986:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587113.310987:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587113.310988:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587113.310989:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587113.310990:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587113.310991:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587113.311019:0:17922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788587113.311042:0:17922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127552000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587113.311348:0:17922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587113.311395:0:17922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb05ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.312465:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552000 00000100:00100000:0.0:1788587113.312476:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552000 00000100:00100000:0.0:1788587113.312530:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587113.312540:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17922:x1875469127552000:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587113.312576:0:17186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587113.312588:0:17186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788587113.315597:0:17171:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788587113.319779:0:17186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788587113.319806:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788587113.319916:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587113.319921:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587113.319945:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.319966:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.319975:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.319983:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320025:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320041:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 18 pid: 17184 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.320055:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127552128:0@lo:104: 00000100:00100000:2.0:1788587113.320117:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587113.320163:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320171:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 18 pid: 17185 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.320180:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127552256:0@lo:104: 00000100:00100000:2.0:1788587113.320202:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.320228:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbc842f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587113.320265:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552128 00000100:00100000:2.0:1788587113.320273:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552128 00000100:00100000:2.0:1788587113.320303:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552256 00000100:00100000:2.0:1788587113.320307:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552256 00000100:00100000:2.0:1788587113.320323:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587113.320331:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+4:17207:x1875469127552128:12345-0@lo:104: 00010000:00010000:2.0:1788587113.320344:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320393:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587113.320399:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+4:17207:x1875469127552128:12345-0@lo:104: Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.320406:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587113.320444:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587113.320451:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127552256:12345-0@lo:104: 00010000:00010000:2.0:1788587113.320459:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320490:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587113.320495:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127552256:12345-0@lo:104: Request processed in 45us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.320500:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587113.320536:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127552128:0@lo:104: 00000100:00100000:2.0:1788587113.320545:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127552256:0@lo:104: 00010000:00010000:2.0:1788587113.320565:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320582:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587113.320596:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320602:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71e00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587113.320606:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320615:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587113.320621:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.320627:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587113.320671:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320678:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587113.320697:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320704:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71e00/0xfbc93bbea5fdab17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab1e expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320716:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587113.320718:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320724:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587113.320727:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320744:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587113.320750:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587113.320754:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587113.320769:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320773:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587113.320780:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320786:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaa53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa5a expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.320797:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587113.320799:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587113.320801:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587113.320807:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587113.320817:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127552384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587113.320844:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.320866:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587113.320871:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127552512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587113.320888:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.320919:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552384 00000100:00100000:2.0:1788587113.320923:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552384 00010000:00010000:2.0:1788587113.320945:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 19 pid: 17184 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.320964:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552512 00000100:00100000:2.0:1788587113.320967:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552512 00010000:00010000:2.0:1788587113.320976:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 20 pid: 17185 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.320987:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587113.320992:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+20:3646:x1875469127552384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587113.321001:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587113.321006:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 20 pid: 17184 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321017:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 20 pid: 17184 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321028:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdab1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdab17 expref: 20 pid: 17184 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321039:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587113.321065:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+19:3646:x1875469127552384:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.321072:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587113.321085:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587113.321090:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+18:3646:x1875469127552512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587113.321097:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587113.321101:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 18 pid: 17185 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321120:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 18 pid: 17185 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321131:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdaa5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa53 expref: 18 pid: 17185 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321143:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321151:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587113.321163:0:17176:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006640092s 00010000:00010000:2.0:1788587113.321167:0:17176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321174:0:17176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321180:0:17176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321187:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321192:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587113.321196:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321203:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321221:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321230:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587113.321255:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+17:3646:x1875469127552512:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.321261:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587113.321291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127552512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587113.321299:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127552384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587113.321315:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321322:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.321328:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdab56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587113.322141:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+16:17922:x1875469127552000:12345-0@lo:253:mount.lustre.0 Request processed in 9599us (10789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.322151:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587113.324707:0:17922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:17922:1875469127552000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587113.324727:0:17922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788587113.324730:0:17922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587113.324732:0:17922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788587113.324734:0:17922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587113.324735:0:17922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587113.324736:0:17922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587113.324737:0:17922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587113.324739:0:17922:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788587113.324741:0:17922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587113.324742:0:17922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788587113.324759:0:17922:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1788587113.339649:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788587113.339730:0:17948:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788587113.339734:0:17948:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788587113.342000:0:17949:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788587113.342237:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788587113.342800:0:17949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587113.344828:0:17949:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788587113.344902:0:17949:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788587113.345438:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875469127552640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587113.345519:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.345550:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71f00 going to sleep for 11 seconds 00000040:01000000:1.0:1788587113.345738:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788587113.345847:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788587113.346274:0:17922:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788587113.346282:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788587113.346319:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587113.347020:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552640 00000100:00100000:0.0:1788587113.347030:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552640 00000100:00100000:0.0:1788587113.347089:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587113.347100:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17950:x1875469127552640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587113.347208:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17950:x1875469127552640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.347215:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587113.347290:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875469127552640:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788587113.347323:0:17950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788587113.347359:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875469127552768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587113.347396:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.347441:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.347506:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552768 00000100:00100000:0.0:1788587113.347511:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552768 00000100:00100000:0.0:1788587113.347533:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587113.347539:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17950:x1875469127552768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587113.347626:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17950:x1875469127552768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.347633:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587113.347709:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875469127552768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587113.347770:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17950:1875469127552896:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788587113.347799:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.347821:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.347983:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127552896 00000100:00100000:0.0:1788587113.347988:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127552896 00000100:00100000:0.0:1788587113.348021:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587113.348028:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17950:x1875469127552896:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788587113.348066:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17950:x1875469127552896:12345-0@lo:900:lod0001_rec0000.0 Request processed in 39us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.348089:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587113.348147:0:17950:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f5a84521500 x1875469127552896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587129 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587113.348159:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17950:1875469127552896:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788587113.348195:0:17950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875469127553024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587113.348217:0:17950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587113.348238:0:17950:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587113.348277:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553024 00000100:00100000:0.0:1788587113.348281:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553024 00000100:00100000:0.0:1788587113.348302:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587113.348308:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17950:x1875469127553024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587113.348363:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17950:x1875469127553024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 55us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587113.348370:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587113.348854:0:17950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17950:1875469127553024:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788587113.349062:0:17950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587113.350269:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788587113.353681:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788587113.353757:0:17922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788587113.355666:0:17922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788587113.356342:0:17922:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:2.0:1788587113.356793:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788587113.356867:0:17950:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788587113.356872:0:17950:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788587113.366190:0:17922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788587113.382476:0:17922:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788587113.382513:0:17922:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffacde414eb988 00100000:10000000:0.0:1788587113.382521:0:17922:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788587113.387909:0:17922:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587113.387948:0:17922:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587113.387965:0:17922:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788587113.387985:0:17922:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788587113.392312:0:17922:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587113.392562:0:17922:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788587113.876776:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587114.326275:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000040:00080000:3.0:1788587114.326858:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788587114.836550:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587114.836558:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5bb05d5000 from 8 10000000:01000000:2.0:1788587114.836563:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587114.836621:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587114.836633:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587114.836652:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587114.836677:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587114.836741:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.836805:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587114.836867:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553152 00000100:00100000:3.0:1788587114.836875:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553152 00000100:00100000:3.0:1788587114.836928:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587114.836937:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+16:17188:x1875469127553152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587114.836950:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587114.836964:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab5d expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587114.836987:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587114.836997:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587114.837007:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1b000, rc 0) 00000100:00100000:3.0:1788587114.837056:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127553152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587114.837062:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587114.837211:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587114.837226:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587114.837235:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587114.837292:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587114.837323:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587114.837348:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b851690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587114.837813:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553280 00000100:00100000:2.0:1788587114.837819:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553280 00000100:00100000:2.0:1788587114.837860:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587114.837868:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127553280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587114.837884:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587114.837903:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587114.837907:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788587114.837992:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127553280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.837999:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587114.838107:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587114.838155:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587114.838163:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587114.838177:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587114.838186:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587114.838188:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5a8450b800 from 8 10000000:01000000:0.0:1788587114.838191:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587114.838212:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587114.838219:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587114.838226:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587114.838241:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587114.838267:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587114.838295:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b851690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587114.838449:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553408 00000100:00100000:2.0:1788587114.838454:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553408 00000100:00100000:2.0:1788587114.838477:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587114.838483:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127553408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587114.838498:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587114.838508:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab6b expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587114.838525:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587114.838534:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 18 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587114.838542:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70000, rc 0) 00000100:00100000:2.0:1788587114.838582:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127553408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.838588:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788587114.838720:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587114.838733:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587114.838740:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587114.838784:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587114.838814:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587114.838848:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587114.838906:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553536 00000100:00100000:0.0:1788587114.838910:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553536 00000100:00100000:0.0:1788587114.838941:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587114.838948:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba07b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127553536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587114.838958:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587114.838969:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587114.838972:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788587114.839058:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba07b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127553536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587114.839066:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587114.839078:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127553536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587114.839122:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587114.839129:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587114.839138:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587114.901194:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587115.351786:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000040:00080000:3.0:1788587115.352616:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587115.930251:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587116.376760:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788587116.948877:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587117.396975:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000001:02000400:1.0:1788587117.634811:0:18193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788587117.972616:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587118.420567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127553664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587118.420642:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587118.420784:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553664 00000100:00100000:0.0:1788587118.420794:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553664 00000100:00100000:0.0:1788587118.420855:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587118.420866:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127553664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587118.420897:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788587118.420942:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127553664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.420950:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587118.421111:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 0 seconds 00000100:00100000:3.0:1788587118.421269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127553664:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788587118.421683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587118.421688:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788587118.421692:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587118.421699:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f5baaa5a800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587118.421722:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84465500 x1875469127553920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587118.421736:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587118.421740:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587118.421742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587118.421746:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587118.421769:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587118.421773:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587118.421775:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587118.421778:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587118.422155:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127553920:0@lo:38:kworker.0 00000100:00100000:3.0:1788587118.422201:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587118.422215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127553792:0@lo:400:kworker.0 00000100:00100000:1.0:1788587118.422217:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587118.422261:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587118.422404:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553792 00000100:00100000:3.0:1788587118.422411:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553792 00000100:00100000:3.0:1788587118.422493:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587118.422502:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:3648:x1875469127553792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.422539:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127553920 00000100:00100000:3.0:1788587118.422550:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:3648:x1875469127553792:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.422556:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127553920 00000100:00100000:3.0:1788587118.422560:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788587118.422584:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587118.422603:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127553792:0@lo:400:kworker.0 00000100:00100000:0.0:1788587118.422604:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875469127553920:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788587118.422643:0:17931:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000100:00100000:3.0:1788587118.422651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127554048:0@lo:400:kworker.0 00000020:00000080:0.0:1788587118.422682:0:17931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fdab79 00000100:00100000:3.0:1788587118.422686:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1788587118.422699:0:17931:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788587118.422706:0:17931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788587118.422711:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587118.422718:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127554176:0@lo:400:kworker.0 00000100:00100000:3.0:1788587118.422743:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587118.422770:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554048 00000100:00100000:3.0:1788587118.422773:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554048 00000100:00100000:3.0:1788587118.422799:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554176 00000100:00100000:3.0:1788587118.422802:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554176 00000100:00100000:3.0:1788587118.422820:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587118.422830:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127554048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587118.422875:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127554048:12345-0@lo:400:kworker.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.422985:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587118.422998:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127554176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587118.423014:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587118.423036:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127554176:12345-0@lo:400:kworker.0 Request processed in 41us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.423044:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788587118.423056:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a84464a80 x1875469127554176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587118.423067:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127554176:0@lo:400:kworker.0 00010000:00080000:3.0:1788587118.423077:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a84466a00 x1875469127554048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587118.423084:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127554048:0@lo:400:kworker.0 00000100:00080000:0.0:1788587118.436373:0:17931:0:(import.c:65:import_set_state_nolock()) ffff8f5a822e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587118.436495:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875469127553920:12345-0@lo:38:kworker.0 Request processed in 13891us (14279us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587118.436707:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788587118.436717:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788587118.436723:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788587118.436830:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5baaa5a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788587118.436848:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ac631c4f): req@ffff8f5bb4e34a80 x1875469127546880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587118.436865:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127553920:0@lo:38:kworker.0 00000100:00100000:0.0:1788587118.436917:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587118.436938:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587118.436957:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587118.437256:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127546880 00000100:00100000:0.0:1788587118.437263:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127546880 00000100:00100000:0.0:1788587118.437575:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587118.437747:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17232:x1875469127546880:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788587118.437873:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1875469127546880:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788587118.437906:0:17232:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788587118.437948:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1875469127554304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788587118.437980:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587118.438005:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587118.438016:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554304 00000100:00100000:2.0:1788587118.438019:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554304 00000100:00100000:2.0:1788587118.438036:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587118.438041:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17232:x1875469127554304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587118.438264:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17232:x1875469127546880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 680us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.438271:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587118.438327:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587118.438336:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127554432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587118.438362:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587118.438397:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554432 00000100:00100000:0.0:1788587118.438401:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554432 00000100:00100000:0.0:1788587118.438441:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587118.438448:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875469127554432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587118.438468:0:17931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788587118.438518:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875469127554432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.438524:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587118.438552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127554432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587118.440178:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17232:x1875469127554304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2128us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587118.440190:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587118.440407:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1875469127554304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788587118.440547:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1875469127554560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788587118.441931:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587118.441970:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916ddb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587118.443867:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554560 00000100:00100000:0.0:1788587118.443881:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554560 00000100:00100000:0.0:1788587118.443948:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587118.443959:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17232:x1875469127554560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587118.444075:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17232:x1875469127554560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 118us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.444083:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587118.445576:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17232:1875469127554560:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788587118.445666:0:17232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587118.452534:0:17232:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788587118.452630:0:17232:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788587118.452636:0:17232:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788587118.545388:0:18245:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788587118.545722:0:18245:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788587119.001227:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788587119.432375:0:18296:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587119.432908:0:18296:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788587120.022937:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587120.439158:0:18344:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea26aca20 20000000:00000080:2.0:1788587120.439821:0:18344:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5b83517c00 uarg=0000000000000000 20000000:01000000:2.0:1788587120.439863:0:18344:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788587120.439869:0:18344:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788587120.439874:0:18344:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788587120.440286:0:18345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788587120.440796:0:18344:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788587120.447889:0:18344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788587120.447921:0:18344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.447940:0:18344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.447947:0:18344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.447969:0:18344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.448011:0:18344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.448024:0:18344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587120.448035:0:18344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18344:1875469127554688:0@lo:104: 00000100:00100000:2.0:1788587120.448087:0:18344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587120.448142:0:18344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.448150:0:18344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587120.448158:0:18344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18344:1875469127554816:0@lo:104: 00000100:00100000:1.0:1788587120.448159:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554688 00000100:00100000:1.0:1788587120.448166:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554688 00000100:00100000:2.0:1788587120.448178:0:18344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587120.448201:0:18344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90712840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587120.448264:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554816 00000100:00100000:0.0:1788587120.448268:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554816 00000100:00100000:0.0:1788587120.448293:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587120.448300:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+4:18344:x1875469127554816:12345-0@lo:104: 00010000:00010000:0.0:1788587120.448312:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448436:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587120.448443:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.448448:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1788587120.448451:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71a00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587120.448455:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448464:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587120.448470:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587120.448475:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587120.448508:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448516:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587120.448537:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448544:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaa22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdaa29 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448555:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587120.448557:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587120.448570:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587120.448581:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127554944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587120.448627:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587120.448665:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+4:18344:x1875469127554816:12345-0@lo:104: Request processed in 363us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587120.448684:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587120.448691:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127554944 00000100:00100000:3.0:1788587120.448695:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127554944 00000100:00100000:0.0:1788587120.448699:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587120.448705:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+3:18344:x1875469127554688:12345-0@lo:104: 00010000:00010000:3.0:1788587120.448710:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 18 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.448712:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587120.448742:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788587120.448745:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587120.448749:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+18:3649:x1875469127554944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587120.448749:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+3:18344:x1875469127554688:12345-0@lo:104: Request processed in 46us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587120.448755:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788587120.448758:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587120.448763:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 18 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448772:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 18 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448789:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587120.448823:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+18:3649:x1875469127554944:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587120.448830:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788587120.448847:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587120.448852:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448858:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70e00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587120.448861:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448869:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587120.448875:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587120.448881:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587120.448910:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448916:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587120.448940:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448948:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdab25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab2c expref: -99 pid: 17922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.448960:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587120.448961:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587120.448963:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587120.448975:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587120.448983:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127555072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587120.449009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587120.449014:0:18344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18344:1875469127554688:0@lo:104: 00010000:00010000:2.0:1788587120.449025:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1aa00/0xfbc93bbea5fdaa29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdaa22 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587120.449034:0:18344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18344:1875469127554816:0@lo:104: 00010000:00010000:2.0:1788587120.449051:0:18344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587120.449218:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555072 00000100:00100000:3.0:1788587120.449222:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555072 00010000:00010000:3.0:1788587120.449234:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587120.449254:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587120.449260:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+17:3647:x1875469127555072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587120.449268:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587120.449272:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449281:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449292:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdab25 expref: 17 pid: 17186 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449303:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449311:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449323:0:17176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449329:0:17176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449347:0:17176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449354:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449359:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587120.449363:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449370:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449383:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.449392:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587120.449402:0:18344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.449409:0:18344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587120.449440:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+16:3647:x1875469127555072:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587120.449447:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587120.449471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127555072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587120.449490:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127554944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587120.449527:0:18344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bbfa71400/0xfbc93bbea5fdab80 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.047718:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587121.434327:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587122.069453:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788587122.132479:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587122.132487:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bb05d5000 from 13 10000000:01000000:1.0:1788587122.132493:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587122.132537:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.132559:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.132570:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587122.132605:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587122.132672:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587122.132720:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbca7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587122.132746:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555200 00000100:00100000:3.0:1788587122.132753:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555200 00000100:00100000:3.0:1788587122.132801:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587122.132810:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+16:17188:x1875469127555200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587122.132832:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587122.132845:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab87 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.132867:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.132878:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.132887:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1ba00, rc 0) 00000100:00100000:3.0:1788587122.132945:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127555200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587122.132951:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587122.132969:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587122.132983:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.132999:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587122.133066:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587122.133089:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587122.133111:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbca7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587122.133129:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555328 00000100:00100000:3.0:1788587122.133133:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555328 00000100:00100000:3.0:1788587122.133174:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587122.133186:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127555328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587122.133310:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127555328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587122.133317:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788587122.133411:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587122.133469:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587122.133520:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587122.133537:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbca7f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587122.133635:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555456 00000100:00100000:3.0:1788587122.133639:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555456 00000100:00100000:3.0:1788587122.133669:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587122.133676:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127555456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587122.133830:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127555456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587122.133847:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587122.133915:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587122.139029:0:18415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788587122.139305:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788587122.139326:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587122.139338:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.139348:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587122.139358:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587122.139361:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a8450b800 from 13 10000000:01000000:0.0:1788587122.139365:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587122.139411:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.139444:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.139472:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587122.139498:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587122.139688:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587122.139734:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4c7f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587122.139955:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555584 00000100:00100000:3.0:1788587122.139963:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555584 00000100:00100000:3.0:1788587122.140015:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788587122.140025:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+17:17188:x1875469127555584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587122.140036:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587122.140050:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdab95 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.140072:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.140082:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.140091:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1ae00, rc 0) 00000100:00100000:3.0:1788587122.140145:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127555584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587122.140151:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587122.140529:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587122.140619:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.140630:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587122.140691:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587122.140721:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587122.140749:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4c7f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587122.141332:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555712 00000100:00100000:1.0:1788587122.141340:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555712 00000100:00100000:1.0:1788587122.141385:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587122.141394:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127555712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587122.143686:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127555712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2287us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587122.143700:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788587122.149138:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587122.149203:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587122.149291:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587122.149340:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcb14900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587122.150601:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555840 00000100:00100000:1.0:1788587122.150613:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555840 00000100:00100000:1.0:1788587122.150674:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587122.150685:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127555840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587122.150841:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:17188:x1875469127555840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587122.150859:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788587122.151719:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127555840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587122.154737:0:18417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788587122.155001:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788587122.155026:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587122.155048:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.155061:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.096049:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587123.542542:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587113/real 1788587113] req@ffff8f5a84467b80 x1875469127550080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.542573:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84467b80 x1875469127550080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.542595:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587113/real 1788587113] req@ffff8f5a83108700 x1875469127549952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.542609:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a83108700 x1875469127549952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587123.542627:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788587123.542884:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127555968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587123.542946:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587123.543027:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127555968 00000100:00100000:3.0:1788587123.543035:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127555968 00000100:00080000:2.0:1788587123.546086:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587123.546096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127550080:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788587123.546108:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cff800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587123.546115:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587123.546118:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127549952:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788587123.547605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127556096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587123.547672:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788587123.552929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587123.552935:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587123.552937:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587123.552940:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587123.552969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587123.552973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788587123.552976:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cff800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587123.552984:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1788587123.552998:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587123.553004:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f5bb4cff800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587123.553013:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127556352:0@lo:400:kworker.0 00000100:00100000:0.0:1788587123.553024:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84465f80 x1875469127556480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587123.553040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587123.553043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587123.553045:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587123.553048:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1788587123.553050:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587123.553053:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f5bbfa54800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587123.553061:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84466300 x1875469127556608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587123.553077:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587123.553093:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127556096 00000100:00100000:0.0:1788587123.553098:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127556096 00000100:00100000:2.0:1788587123.553110:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587123.553127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127556736:0@lo:400:kworker.0 00000100:00100000:2.0:1788587123.553149:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587123.553174:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127556352 00000100:00100000:2.0:1788587123.553178:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127556352 00000100:00100000:2.0:1788587123.553210:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127556736 00000100:00100000:2.0:1788587123.553213:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127556736 00000100:00100000:2.0:1788587123.553239:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587123.553249:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127556352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587123.553294:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127556352:12345-0@lo:400:kworker.0 Request processed in 46us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587123.553302:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587123.553317:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587123.553322:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127556736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587123.553358:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127556736:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587123.553364:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788587123.553394:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a84467100 x1875469127556736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.553408:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127556736:0@lo:400:kworker.0 00010000:00080000:2.0:1788587123.553436:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a84466d80 x1875469127556352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587123.553453:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127556352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587123.555821:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127556224:0@lo:400:kworker.0 00000100:00100000:1.0:1788587123.555891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587123.555951:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127556224 00000100:00100000:1.0:1788587123.555958:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127556224 00000100:00100000:1.0:1788587123.555998:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587123.556006:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:3649:x1875469127556224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587123.556514:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:3649:x1875469127556224:12345-0@lo:400:kworker.0 Request processed in 506us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587123.556522:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587123.556580:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127556224:0@lo:400:kworker.0 00000100:00100000:1.0:1788587123.558490:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127556480:0@lo:8:kworker.0 00000400:00000100:1.0:1788587123.558548:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127556480 offset 0 length 520: 4 00000100:00100000:1.0:1788587123.558594:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127556608:0@lo:8:kworker.0 00000400:00000100:1.0:1788587123.558614:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127556608 offset 0 length 520: 4 00000100:00100000:3.0:1788587123.559915:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587123.559935:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127555968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587123.559985:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788587123.560064:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127555968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (17117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.560071:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587123.561548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127555968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587123.564560:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587123.564594:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127556096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587123.564636:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587123.564719:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127556096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (17046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587123.564726:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587123.567063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127556096:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788587124.054454:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788587124.117315:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587124.572685:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587109/real 1788587109] req@ffff8f5bb4e36300 x1875469127547904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587124.572726:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5bb4e36300 x1875469127547904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587124.572737:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587109/real 1788587109] req@ffff8f5bb4e37800 x1875469127548032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587124 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587124.572748:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5bb4e37800 x1875469127548032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587124 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587124.572769:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587124.572778:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788587124.572782:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127547904:0@lo:8:kworker.0 00000100:00080000:1.0:1788587124.572787:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587124.572791:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788587124.572794:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127548032:0@lo:8:kworker.0 00000100:00080000:2.0:1788587124.573739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587124.573743:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587124.573745:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587124.573752:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:2.0:1788587124.573757:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587124.573764:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f5bb4f7b000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587124.573782:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84521500 x1875469127557120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587124.573796:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587124.573799:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587124.573800:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587124.573803:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:2.0:1788587124.573806:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587124.573809:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f5bb4cfe000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587124.573822:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5ba7aa7480 x1875469127557248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587124.573852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587124.573855:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587124.573857:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587124.573868:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587124.573897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127556992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.574032:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127556864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.579182:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.579315:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127557632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.579358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.579675:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127556864 00000100:00100000:1.0:1788587124.579684:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127556864 00000100:00100000:1.0:1788587124.579731:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587124.579739:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:3648:x1875469127556864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.579794:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:3648:x1875469127556864:12345-0@lo:400:kworker.0 Request processed in 56us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.579816:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587124.579848:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127557632 00000100:00100000:1.0:1788587124.579852:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127557632 00000100:00100000:1.0:1788587124.579878:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587124.579885:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127557632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.579916:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127557632:12345-0@lo:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.579922:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587124.579957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127556864:0@lo:400:kworker.0 00010000:00080000:1.0:1788587124.579971:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5ba7aa4000 x1875469127557632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587124.579993:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127557632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.581637:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127557376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.581698:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.581734:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587124.581742:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127557504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.581796:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.581841:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127557120:0@lo:8:kworker.0 00000400:00000100:1.0:1788587124.581862:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127557120 offset 0 length 520: 4 00000100:00100000:1.0:1788587124.581883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127557248:0@lo:8:kworker.0 00000400:00000100:1.0:1788587124.581897:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469127557248 offset 0 length 520: 4 00000100:00100000:1.0:1788587124.581922:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127557376 00000100:00100000:1.0:1788587124.581928:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127557376 00000100:00100000:1.0:1788587124.581992:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587124.582009:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127557376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.582068:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127557376:12345-0@lo:400:kworker.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.582074:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788587124.582448:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5ba7aa4a80 x1875469127557376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587124.582463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127557376:0@lo:400:kworker.0 00000100:00100000:2.0:1788587124.582814:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587124.582894:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127557504 00000100:00100000:2.0:1788587124.582900:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127557504 00000100:00100000:2.0:1788587124.582936:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127556992 00000100:00100000:2.0:1788587124.582939:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127556992 00000100:00100000:0.0:1788587124.583044:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587124.583055:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587124.583118:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127557504:12345-0@lo:400:kworker.0 Request processed in 67us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587124.583125:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587124.583160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127557504:0@lo:400:kworker.0 00000100:00100000:2.0:1788587124.583329:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587124.583337:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127556992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587124.583389:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127556992:12345-0@lo:400:kworker.0 Request processed in 54us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587124.583395:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587124.583442:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127556992:0@lo:400:kworker.0 00010000:00010000:3.0:1788587125.153241:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587125.589915:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587126.164595:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587126.929307:0:18692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587126.929312:0:18692:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788587126.929314:0:18692:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788587126.929478:0:18692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f5a81bce000 00000020:01000004:2.0:1788587126.929492:0:18692:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788587126.929505:0:18692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788587126.929519:0:18692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f5a82434d40) 00000020:00000080:2.0:1788587126.929534:0:18692:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788587126.968983:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788587126.971466:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788587126.971891:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788587126.972081:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788587126.972293:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788587126.972576:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788587126.972895:0:18692:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1788587126.973788:0:18692:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788587126.974326:0:18692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788587126.974339:0:18692:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788587126.974350:0:18692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfbc93bbea5fdabaa 00000020:01000004:1.0:1788587126.974356:0:18692:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788587126.974375:0:18692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788587126.974379:0:18692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788587126.974385:0:18692:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788587126.974389:0:18692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788587126.974554:0:18692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f5b85b899c0) 00000020:00000080:1.0:1788587126.974578:0:18692:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788587126.975702:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587126.975863:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788587126.975868:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788587126.979053:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587126.979065:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788587126.979651:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788587126.979659:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788587126.981044:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587126.981236:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587126.981243:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788587126.983805:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788587126.983817:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788587127.009732:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587127.009996:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587127.010003:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788587127.011614:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587127.011627:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788587127.013857:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587127.013871:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788587127.017035:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587127.017228:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587127.017234:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788587127.017950:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587127.017959:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788587127.077321:0:18692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587127.078791:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587127.078799:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788587127.080136:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587127.080148:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788587127.081005:0:18692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788587127.081035:0:18692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788587127.081042:0:18692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788587127.095057:0:18692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788587127.095135:0:18692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.101@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788587127.095140:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788587127.095142:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587127.095143:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587127.095144:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587127.095146:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587127.095147:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587127.095149:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587127.095151:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587127.095152:0:18692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587127.095156:0:18692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788587127.095158:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587127.095160:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587127.095161:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587127.095162:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587127.095163:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587127.095164:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587127.095165:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587127.095167:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587127.095168:0:18692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788587127.095194:0:18692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788587127.095214:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127557760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587127.095297:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587127.095352:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587127.095452:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127557760 00000100:00100000:1.0:1788587127.095460:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127557760 00000100:00100000:1.0:1788587127.095519:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587127.095530:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:18692:x1875469127557760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587127.095736:0:17185:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788587127.095740:0:17185:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788587127.095744:0:17185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788587127.096011:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+18:18692:x1875469127557760:12345-0@lo:253:mount.lustre.0 Request processed in 481us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.096021:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587127.096471:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127557760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587127.096482:0:18692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788587127.096485:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587127.096486:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587127.096487:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587127.096488:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587127.096489:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587127.096490:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587127.096491:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587127.096492:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587127.096493:0:18692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587127.096511:0:18692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5a81bce000 from lustre-OST0000 10000000:01000000:2.0:1788587127.096541:0:18692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788587127.096544:0:18692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788587127.096551:0:18692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f5a83343380 local copy 00010000:00010000:2.0:1788587127.096737:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.096889:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127557888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587127.096937:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.096981:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587127.097381:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127557888 00000100:00100000:1.0:1788587127.097388:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127557888 00000100:00100000:1.0:1788587127.097463:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587127.097474:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:18692:x1875469127557888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587127.097633:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+18:18692:x1875469127557888:12345-0@lo:501:mount.lustre.0 Request processed in 89us (624us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587127.097643:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788587127.097769:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127557888:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788587127.097797:0:18692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788587127.097816:0:18692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788587127.097823:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.097833:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587127.097861:0:18692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5a81bce000 10000000:01000000:3.0:1788587127.097865:0:18692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788587127.097871:0:18692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788587127.097873:0:18692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587127.097877:0:18692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788587127.097880:0:18692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788587127.097903:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.097911:0:18692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.097919:0:18692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.097935:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587127.097965:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.098090:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587127.098146:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558016 00000100:00100000:1.0:1788587127.098150:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558016 00000100:00100000:0.0:1788587127.098990:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587127.099004:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+18:18692:x1875469127558016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587127.099016:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587127.099030:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fdabbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdabb8 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.099051:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fdabbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabb8 expref: 19 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.099113:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4200/0xfbc93bbea5fdabbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabb8 expref: 19 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.099122:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4200, rc 0) 00000100:00100000:0.0:1788587127.099225:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558016:12345-0@lo:101:mount.lustre.0 Request processed in 226us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.099231:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587127.099354:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587127.099370:0:18692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabbf expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.099390:0:18692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdabbf expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587127.100721:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788587127.101804:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587127.108925:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788587127.108982:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788587127.108999:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788587127.109012:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788587127.109041:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788587127.109054:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788587127.109077:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788587127.109082:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788587127.109183:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587127.109247:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.109292:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb5b2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788587127.109571:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558144 00000100:00100000:2.0:1788587127.109579:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558144 00000100:00100000:2.0:1788587127.109644:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788587127.109654:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587127.109985:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558144:12345-0@lo:501:mount.lustre.0 Request processed in 331us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.109993:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788587127.110142:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587127.110175:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587127.110220:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.110257:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb5b2f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587127.110372:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558272 00000100:00100000:1.0:1788587127.110378:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558272 00000100:00100000:1.0:1788587127.110482:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587127.110494:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587127.111256:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558272:12345-0@lo:503:mount.lustre.0 Request processed in 762us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.111265:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587127.111342:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558272:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587127.111803:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587127.111870:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.111916:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.111953:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587127.112191:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558400 00000100:00100000:2.0:1788587127.112199:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558400 00000100:00100000:2.0:1788587127.112230:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587127.112238:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587127.112858:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558400:12345-0@lo:502:mount.lustre.0 Request processed in 619us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.112872:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788587127.112949:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.113123:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788587127.113152:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788587127.113166:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788587127.113182:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788587127.113196:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788587127.113210:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788587127.113222:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788587127.113234:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788587127.113246:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788587127.113258:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788587127.113269:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788587127.113295:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788587127.113323:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.113363:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.113402:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.113486:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558528 00000100:00100000:0.0:1788587127.113492:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558528 00000100:00100000:0.0:1788587127.113518:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788587127.113525:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587127.113840:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558528:12345-0@lo:502:mount.lustre.0 Request processed in 313us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.113847:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587127.113930:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.113968:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788587127.113977:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788587127.115091:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587127.115100:0:18709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788587127.115106:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587127.115109:0:18709:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788587127.115115:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587127.115138:0:18709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f5a8334cd40) 00000020:00000080:2.0:1788587127.115160:0:18709:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788587127.115166:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788587127.115236:0:18709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a81bce000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788587127.115246:0:18709:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788587127.115253:0:18709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xfbc93bbea5fdabcd 00010000:00010000:0.0:1788587127.119912:0:18709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788587127.120904:0:18709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788587127.122818:0:18709:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788587127.124248:0:18709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788587127.124260:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587127.124266:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587127.124268:0:18709:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788587127.124272:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788587127.124274:0:18709:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788587127.124276:0:18709:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788587127.124278:0:18709:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788587127.124279:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788587127.124282:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587127.124283:0:18709:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788587127.124285:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587127.124288:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587127.124289:0:18709:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788587127.124292:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788587127.124294:0:18709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788587127.124296:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587127.124298:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587127.124299:0:18709:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788587127.124301:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587127.124303:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587127.124304:0:18709:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788587127.124307:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788587127.124331:0:18709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587127.124334:0:18709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587127.124335:0:18709:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788587127.124338:0:18709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788587127.124594:0:18692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788587127.124638:0:18692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788587127.124656:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabbf expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.124675:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1be00/0xfbc93bbea5fdabb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabbf expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587127.124691:0:18692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a81bce000 from 1 10000000:01000000:1.0:1788587127.124693:0:18692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587127.124727:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.124735:0:18692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.124746:0:18692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587127.124769:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587127.124829:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587127.124861:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.125142:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558656 00000100:00100000:0.0:1788587127.125149:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558656 00000100:00100000:0.0:1788587127.125197:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788587127.125207:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+19:18692:x1875469127558656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587127.125219:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587127.125232:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdabd4 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.125264:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.125274:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.125283:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5200, rc 0) 00000100:00100000:0.0:1788587127.125322:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127558656:12345-0@lo:101:mount.lustre.0 Request processed in 116us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.125329:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587127.128905:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587127.128933:0:18692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.128947:0:18692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587127.134153:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788587127.134633:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587127.134950:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788587127.134974:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788587127.135002:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788587127.135008:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788587127.135084:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587127.135152:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587127.135197:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587127.135362:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558784 00000100:00100000:3.0:1788587127.135370:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558784 00000100:00100000:3.0:1788587127.135452:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788587127.135463:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127558784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587127.135587:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127558784:12345-0@lo:501:mount.lustre.0 Request processed in 126us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.135594:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587127.135821:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587127.135854:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587127.135894:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587127.135925:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f99300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.136004:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127558912 00000100:00100000:0.0:1788587127.136008:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127558912 00000100:00100000:0.0:1788587127.136034:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788587127.136041:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127558912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587127.136117:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127558912:12345-0@lo:503:mount.lustre.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.136124:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587127.136263:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127558912:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587127.136915:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587127.136979:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587127.137024:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587127.137040:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b88f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.137105:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559040 00000100:00100000:0.0:1788587127.137110:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559040 00000100:00100000:0.0:1788587127.137146:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587127.137154:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127559040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587127.137241:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127559040:12345-0@lo:502:mount.lustre.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.137249:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587127.137333:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.137542:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788587127.137588:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788587127.137606:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788587127.137642:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788587127.137660:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788587127.137687:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788587127.137704:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788587127.137719:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788587127.137733:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788587127.137747:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788587127.137767:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788587127.137792:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.137830:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.137865:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.138205:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559168 00000100:00100000:0.0:1788587127.138210:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559168 00000100:00100000:0.0:1788587127.138246:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587127.138253:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127559168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587127.138329:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127559168:12345-0@lo:502:mount.lustre.0 Request processed in 75us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.138336:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587127.138515:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.138754:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788587127.138766:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788587127.140162:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587127.140173:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140176:0:18713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587127.140182:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5a81bce000 00000020:00000080:1.0:1788587127.140185:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587127.140191:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587127.140194:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140195:0:18713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788587127.140197:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587127.140199:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140201:0:18713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587127.140204:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5a81bce000 00000020:00000080:1.0:1788587127.140206:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587127.140305:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587127.140310:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140311:0:18713:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788587127.140314:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587127.140317:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140324:0:18713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587127.140328:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5a81bce000 00000020:00000080:1.0:1788587127.140330:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587127.140600:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587127.140605:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140809:0:18713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587127.140815:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587127.140819:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140820:0:18713:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788587127.140823:0:18713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5a81bce000 00000020:00000080:1.0:1788587127.140825:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587127.140856:0:18713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587127.140859:0:18713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587127.140861:0:18713:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788587127.140864:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788587127.141014:0:18692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788587127.141052:0:18692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587127.141075:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.141088:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587127.141141:0:18692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587127.141144:0:18692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5a81bce000 10000000:01000000:3.0:1788587127.141147:0:18692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5a81bce000 10000000:01000000:3.0:1788587127.141151:0:18692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587127.141157:0:18692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5a81bce000 from 1 10000000:01000000:3.0:1788587127.141160:0:18692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587127.141203:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.141212:0:18692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.141222:0:18692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.141245:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587127.141305:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.141347:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.146543:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559296 00000100:00100000:0.0:1788587127.146556:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559296 00000100:00100000:0.0:1788587127.149050:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587127.149067:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+20:18692:x1875469127559296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587127.149085:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587127.149104:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fdabe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdabe2 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.149282:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fdabe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabe2 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.149297:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4600/0xfbc93bbea5fdabe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabe2 expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.149306:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4600, rc 0) 00000100:00100000:0.0:1788587127.149479:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559296:12345-0@lo:101:mount.lustre.0 Request processed in 415us (8172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.149487:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788587127.150231:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587127.150253:0:18692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabe9 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.150263:0:18692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdabe9 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587127.156090:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788587127.156360:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587127.156584:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788587127.156789:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788587127.156811:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788587127.156827:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788587127.156841:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788587127.156855:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788587127.156869:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788587127.156885:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788587127.156901:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788587127.156930:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788587127.156948:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788587127.156966:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788587127.156984:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788587127.157001:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788587127.157024:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788587127.157043:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788587127.157073:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788587127.157093:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788587127.157110:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788587127.157126:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788587127.157140:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788587127.157157:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788587127.157175:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788587127.157192:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788587127.157211:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788587127.157226:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788587127.157242:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788587127.157257:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788587127.157274:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788587127.157293:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788587127.157311:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788587127.157330:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788587127.157360:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788587127.157377:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788587127.157391:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788587127.157404:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788587127.157443:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788587127.157466:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788587127.157472:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788587127.157575:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587127.158819:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.158915:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6c60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587127.164031:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559424 00000100:00100000:1.0:1788587127.164045:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559424 00000100:00100000:1.0:1788587127.164701:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587127.164716:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587127.164885:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559424:12345-0@lo:501:mount.lustre.0 Request processed in 173us (6070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.164893:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788587127.165710:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587127.165786:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587127.165842:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587127.165877:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559552 00000100:00100000:0.0:1788587127.165885:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559552 00000100:00100000:3.0:1788587127.165887:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6c60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587127.165939:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587127.165948:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587127.166060:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559552:12345-0@lo:503:mount.lustre.0 Request processed in 112us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.166075:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788587127.168108:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559552:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587127.168616:0:18692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587127.168875:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.168942:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.168989:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6c60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587127.169012:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559680 00000100:00100000:3.0:1788587127.169017:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559680 00000100:00100000:3.0:1788587127.169052:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587127.169060:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.169159:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559680:12345-0@lo:502:mount.lustre.0 Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.169167:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587127.169228:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.169385:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788587127.169411:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788587127.169451:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788587127.169465:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788587127.169478:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788587127.169493:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788587127.169508:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788587127.169524:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788587127.169557:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788587127.169597:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788587127.169612:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788587127.169627:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788587127.169836:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788587127.169854:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788587127.169868:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788587127.169882:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788587127.169897:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788587127.169911:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788587127.169925:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788587127.169940:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788587127.169954:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788587127.169969:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788587127.169983:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788587127.169997:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788587127.170027:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788587127.170045:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788587127.170060:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788587127.170073:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788587127.170088:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788587127.170103:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788587127.170117:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788587127.170132:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788587127.170147:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788587127.170162:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788587127.170176:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788587127.170191:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788587127.170275:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788587127.170295:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788587127.170310:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788587127.170324:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788587127.170351:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788587127.170368:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788587127.170391:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788587127.170405:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788587127.170442:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788587127.170461:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788587127.170476:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788587127.170491:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788587127.170536:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.170611:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587127.170778:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559808 00000100:00100000:2.0:1788587127.170786:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559808 00000100:00100000:2.0:1788587127.170826:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587127.170833:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.170860:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587127.170936:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559808:12345-0@lo:502:mount.lustre.0 Request processed in 102us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.170944:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587127.171287:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.171864:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788587127.171891:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788587127.171919:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587127.171964:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.172039:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bad6c60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587127.172196:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127559936 00000100:00100000:2.0:1788587127.172203:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127559936 00000100:00100000:2.0:1788587127.172318:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587127.172326:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587127.173061:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127559936:12345-0@lo:502:mount.lustre.0 Request processed in 734us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.173070:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587127.177893:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127559936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587127.177986:0:18692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788587127.177999:0:18692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788587127.180588:0:18719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788587127.180606:0:18719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f5ba7ab4d40) 00000020:00000080:3.0:1788587127.180781:0:18719:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788587127.180872:0:18719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a81bce000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788587127.180876:0:18719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5a81bce000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788587127.180878:0:18719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5a81bce000 3 00010000:00080000:3.0:1788587127.180907:0:18719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a83355000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.101@tcp at head 00010000:00010000:3.0:1788587127.186954:0:18719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788587127.188834:0:18719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788587127.188880:0:18719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587127.188898:0:18719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xfbc93bbea5fdabf7 00000100:00080000:3.0:1788587127.188908:0:18719:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587127.188915:0:18719:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f5a83355000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587127.188949:0:18719:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a83108e00 x1875469127560064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587127.188999:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127560064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587127.189063:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.189131:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560064 00000100:00100000:3.0:1788587127.189138:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560064 00000100:00100000:3.0:1788587127.189168:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587127.189175:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127560064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788587127.189196:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788587127.189222:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xfbc93bbea5fdabfe 00000004:00100000:3.0:1788587127.189235:0:17191:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788587127.189263:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8f5a83350800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587127.189312:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875469127560064:12345-0@lo:38:llog_process_th.0 Request processed in 135us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.189318:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788587127.189351:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a83108e00 x1875469127560064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587127.189360:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587127.189368:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788587127.189375:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788587127.189378:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587127.189380:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587127.189386:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875469127560064:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788587127.189412:0:18719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788587127.189475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.189479:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587127.189481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.189484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587127.189508:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.189511:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587127.189514:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.189517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587127.189543:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127560192:0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190091:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.190122:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587127.190129:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127560576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190169:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.190215:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127560448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190238:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.190257:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587127.190262:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127560320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.190307:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560192 00000100:00100000:3.0:1788587127.190311:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560192 00000100:00100000:3.0:1788587127.190343:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560448 00000100:00100000:3.0:1788587127.190345:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560448 00000100:00100000:3.0:1788587127.190359:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587127.190370:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127560192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190432:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127560192:12345-0@lo:400:kworker.0 Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.190439:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587127.190452:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587127.190457:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127560448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190486:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127560448:12345-0@lo:400:kworker.0 Request processed in 29us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.190492:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587127.190510:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560576 00000100:00100000:3.0:1788587127.190513:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560576 00000100:00100000:3.0:1788587127.190527:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560320 00000100:00100000:3.0:1788587127.190529:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560320 00000100:00100000:3.0:1788587127.190538:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587127.190544:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127560576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.190981:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127560576:12345-0@lo:400:kworker.0 Request processed in 435us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.190988:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587127.191001:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587127.191008:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127560320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.191157:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127560320:12345-0@lo:400:kworker.0 Request processed in 149us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.191163:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788587127.191199:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a83108700 x1875469127560320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587127.191278:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127560320:0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.191302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127560448:0@lo:400:kworker.0 00010000:00080000:3.0:1788587127.191337:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f5a8310bb80 x1875469127560576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587127.191346:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127560576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587127.191357:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127560192:0@lo:400:kworker.0 00000020:01000004:3.0:1788587127.193174:0:18719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788587127.193190:0:18719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f5ba7ab19c0) 00000020:00000080:3.0:1788587127.193776:0:18719:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788587127.193874:0:18719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a81bce000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788587127.193879:0:18719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5a81bce000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788587127.193881:0:18719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5a81bce000 3 00010000:00080000:3.0:1788587127.193913:0:18719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a83354800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.101@tcp at head 00010000:00010000:2.0:1788587127.197711:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587127.197919:0:18719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788587127.198096:0:18719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788587127.198141:0:18719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587127.198154:0:18719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xfbc93bbea5fdac0c 00000100:00080000:3.0:1788587127.198164:0:18719:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587127.198170:0:18719:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f5a83354800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587127.198218:0:18719:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a845eca80 x1875469127560704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587127.198250:0:18719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788587127.198277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.198281:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587127.198284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.198294:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587127.198298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.198300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587127.198303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587127.198305:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788587127.198518:0:18719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1788587127.198784:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875469127560704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587127.198859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788587127.198929:0:18692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788587127.198954:0:18692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587127.198974:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabe9 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.198984:0:18692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1ac00/0xfbc93bbea5fdabe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdabe9 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788587127.199028:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788587127.199030:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587127.199032:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587127.199033:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587127.199035:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587127.199036:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587127.199037:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587127.199039:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587127.199041:0:18692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587127.199044:0:18692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788587127.199046:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587127.199048:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788587127.199049:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587127.199050:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587127.199051:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587127.199052:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587127.199053:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587127.199055:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587127.199056:0:18692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587127.199072:0:18692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788587127.199084:0:18692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127560832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587127.199118:0:18692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587127.199134:0:18692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eefe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587127.199283:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560704 00000100:00100000:3.0:1788587127.199291:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560704 00000100:00100000:1.0:1788587127.199395:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560832 00000100:00100000:1.0:1788587127.199399:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560832 00000100:00100000:1.0:1788587127.199456:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587127.199465:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127560832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587127.199489:0:17184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788587127.199502:0:17184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788587127.199827:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587127.199834:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875469127560704:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788587127.199854:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788587127.199883:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xfbc93bbea5fdac13 00000004:00100000:3.0:1788587127.199897:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788587127.199926:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8f5a83355800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587127.199991:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875469127560704:12345-0@lo:38:llog_process_th.0 Request processed in 156us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.199999:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788587127.200061:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845eca80 x1875469127560704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587127.200087:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587127.200095:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788587127.200101:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788587127.200106:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788587127.200108:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a83354800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587127.200114:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875469127560704:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788587127.207461:0:17184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788587127.207476:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788587127.207640:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587127.207646:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587127.207684:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.207703:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.207711:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.207719:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.207758:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 21 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.207771:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 21 pid: 17185 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587127.207785:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127560960:0@lo:104: 00000100:00100000:2.0:1788587127.207847:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587127.207891:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.207899:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 21 pid: 17184 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587127.207907:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127561088:0@lo:104: 00000100:00100000:2.0:1788587127.207929:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587127.207951:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587127.208053:0:17174:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788587127.208062:0:17175:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1788587127.208077:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127560960 00000100:00100000:0.0:1788587127.208084:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127560960 00000100:00100000:0.0:1788587127.208115:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561088 00000100:00100000:0.0:1788587127.208118:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561088 00000100:00100000:0.0:1788587127.208130:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587127.208138:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+4:17207:x1875469127560960:12345-0@lo:104: 00010000:00010000:0.0:1788587127.208151:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587127.208196:0:17174:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788587127.208202:0:17174:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788587127.208279:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587127.208286:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+4:17207:x1875469127560960:12345-0@lo:104: Request processed in 148us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.208293:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788587127.208298:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587127.208305:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587127.208309:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788587127.208312:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5a00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:1.0:1788587127.208316:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587127.208316:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcbf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127561088:12345-0@lo:104: 00010000:00010000:0.0:1788587127.208323:0:17175:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.208325:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587127.208332:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587127.208338:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587127.208353:0:17175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587127.208358:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcbf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127561088:12345-0@lo:104: Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.208363:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788587127.208364:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.208380:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587127.208394:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587127.208396:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.208403:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5a00/0xfbc93bbea5fdab6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab72 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.208477:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587127.208479:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587127.208481:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587127.208509:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:18692:x1875469127560832:12345-0@lo:253:mount.lustre.0 Request processed in 9045us (9389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.208526:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788587127.208802:0:18692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:18692:1875469127560832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587127.208806:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127561216:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1788587127.208814:0:18692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788587127.208822:0:18692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587127.208824:0:18692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587127.208826:0:18692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587127.208827:0:18692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587127.208828:0:18692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587127.208829:0:18692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587127.208830:0:18692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587127.208832:0:18692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587127.208834:0:18692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788587127.208835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:0.0:1788587127.208845:0:18692:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788587127.208881:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561216 00000100:00100000:3.0:1788587127.208885:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561216 00010000:00010000:3.0:1788587127.208901:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 21 pid: 17185 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.208919:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587127.208931:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+21:3649:x1875469127561216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587127.208940:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587127.208945:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 21 pid: 17185 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.208955:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 21 pid: 17185 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.208969:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587127.208996:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+21:3649:x1875469127561216:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.209002:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587127.209029:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127561216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587127.209050:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bbfa70000/0xfbc93bbea5fdab72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdab6b expref: 20 pid: 17185 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.209058:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127560960:0@lo:104: 00000100:00100000:3.0:1788587127.209066:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127561088:0@lo:104: 00010000:00010000:3.0:1788587127.209079:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.209339:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587127.209342:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587127.209344:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587127.209376:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.209384:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587127.209387:0:17179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.209394:0:17179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587127.209401:0:17179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587127.209407:0:17179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788587127.209456:0:17179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.209464:0:17179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587127.209479:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.209484:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71600/0xfbc93bbea5fdab5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab64 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.209496:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587127.209498:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587127.209500:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587127.209572:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127561344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587127.209604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587127.209787:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561344 00000100:00100000:3.0:1788587127.209791:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561344 00010000:00010000:3.0:1788587127.209806:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 20 pid: 17184 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.209833:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587127.209841:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb5b56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+20:3646:x1875469127561344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587127.209859:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587127.209863:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 20 pid: 17184 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209873:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 20 pid: 17184 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209884:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdab64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdab5d expref: 20 pid: 17184 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209895:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209902:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587127.209915:0:17178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006640092s 00010000:00010000:3.0:1788587127.209919:0:17178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209926:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209932:0:17178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209938:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209943:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587127.209946:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209959:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209971:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.209979:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587127.210011:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb5b56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+19:3646:x1875469127561344:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.210017:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587127.210062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127561344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587127.210081:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.210088:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.210094:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdac1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788587127.213163:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788587127.216002:0:18692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788587127.216019:0:18692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788587127.216057:0:18692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587127.216099:0:18692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587127.216115:0:18692:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788587127.216132:0:18692:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788587127.217035:0:18692:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788587127.228436:0:18692:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788587127.950765:0:18773:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587127.950977:0:18773:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788587128.213909:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587128.660903:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587128.660926:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127561472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587128.660989:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.661124:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561472 00000100:00100000:1.0:1788587128.661132:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561472 00000100:00100000:1.0:1788587128.661186:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587128.661197:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127561472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587128.661228:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587128.661278:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127561472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.661285:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587128.661327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127561472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587128.669693:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127561600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587128.669760:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.669918:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561600 00000100:00100000:1.0:1788587128.669926:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561600 00000100:00100000:1.0:1788587128.669972:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587128.669981:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127561600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587128.670011:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788587128.670058:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127561600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.670064:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587128.670107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127561600:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1788587129.044504:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788587129.044511:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5bb05d5000 from 9 10000000:01000000:1.0:1788587129.044517:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587129.044599:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.044611:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.044622:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.044652:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127561728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587129.044733:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587129.044777:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b98747e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587129.044899:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561728 00000100:00100000:0.0:1788587129.044908:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561728 00000100:00100000:0.0:1788587129.044960:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788587129.044970:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+19:17188:x1875469127561728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587129.044982:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587129.044996:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdac21 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.045130:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.045141:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 20 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.045150:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4a00, rc 0) 00000100:00100000:1.0:1788587129.045396:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127561728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587129.045412:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.045471:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.045535:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127561856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788587129.045578:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587129.045598:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b98747e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587129.045671:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561856 00000100:00100000:2.0:1788587129.045676:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561856 00000100:00100000:2.0:1788587129.045711:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788587129.045719:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127561856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587129.045732:0:17184:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587129.045747:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587129.045750:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788587129.045837:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127561856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587129.045845:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587129.045932:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127561856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587129.046020:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587129.046027:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.046045:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587129.046054:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587129.046057:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5a8450b800 from 9 10000000:01000000:3.0:1788587129.046059:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587129.046078:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.046086:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.046094:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587129.046108:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127561984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587129.046135:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587129.046162:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4c7f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587129.046401:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127561984 00000100:00100000:2.0:1788587129.046406:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127561984 00000100:00100000:2.0:1788587129.046451:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788587129.046457:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127561984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587129.046466:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587129.046476:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdac2f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.046493:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 22 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.046503:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 22 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.046521:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa70800, rc 0) 00000100:00100000:2.0:1788587129.046563:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+22:17188:x1875469127561984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587129.046569:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788587129.046989:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127561984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587129.047146:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127561728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2176us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.047153:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:3.0:1788587129.047232:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.047243:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587129.047985:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127562112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788587129.048105:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587129.048246:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbd2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587129.048289:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562112 00000100:00100000:1.0:1788587129.048359:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562112 00000100:00100000:1.0:1788587129.048562:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587129.048573:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127562112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788587129.048592:0:17184:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587129.048608:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587129.048611:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788587129.048713:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127562112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.048720:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788587129.048803:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127562112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587129.048859:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587129.048872:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.048881:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.236788:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587130.261823:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587131.284658:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587131.669185:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788587132.244583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587132.244590:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587132.244593:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587132.244596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587132.244611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587132.244614:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587132.244617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587132.244620:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587132.244663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127562624:0@lo:400:kworker.0 00000100:00100000:2.0:1788587132.244707:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127562240:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.244733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587132.244792:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587132.244825:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127562752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587132.244852:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587132.244892:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562240 00000100:00100000:2.0:1788587132.244899:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562240 00000100:00100000:2.0:1788587132.244943:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587132.244952:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:3649:x1875469127562240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587132.245001:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:3649:x1875469127562240:12345-0@lo:400:kworker.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587132.245008:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587132.245041:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562752 00000100:00100000:2.0:1788587132.245045:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562752 00000100:00100000:2.0:1788587132.245069:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587132.245075:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127562752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587132.245108:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127562752:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587132.245125:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587132.245166:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127562240:0@lo:400:kworker.0 00010000:00080000:2.0:1788587132.245182:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845ece00 x1875469127562752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587132.245195:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127562752:0@lo:400:kworker.0 00000100:00100000:1.0:1788587132.245451:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562624 00000100:00100000:1.0:1788587132.245456:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562624 00000100:00100000:1.0:1788587132.245483:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587132.245490:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127562624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587132.245539:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127562624:12345-0@lo:400:kworker.0 Request processed in 49us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587132.245545:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587132.246700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127562624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.246734:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127562368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.246770:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587132.246794:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127562880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.246815:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587132.246830:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587132.246836:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127562496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.248044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587132.253098:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127563008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.253168:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587132.253213:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562368 00000100:00100000:3.0:1788587132.253221:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562368 00000100:00100000:3.0:1788587132.253273:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587132.253282:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127562368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.253360:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127562368:12345-0@lo:400:kworker.0 Request processed in 78us (6588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587132.253368:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587132.253392:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562880 00000100:00100000:3.0:1788587132.253396:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562880 00000100:00100000:3.0:1788587132.253443:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127562496 00000100:00100000:3.0:1788587132.253447:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127562496 00000100:00100000:3.0:1788587132.253458:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563008 00000100:00100000:3.0:1788587132.253460:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563008 00000100:00100000:3.0:1788587132.253473:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587132.253479:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127562880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.253513:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127562880:12345-0@lo:400:kworker.0 Request processed in 34us (6697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587132.253519:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587132.253541:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587132.253547:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127562496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.253573:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127562496:12345-0@lo:400:kworker.0 Request processed in 26us (5530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587132.253578:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587132.253587:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587132.253603:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127563008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.253645:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127563008:12345-0@lo:400:kworker.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587132.253651:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788587132.253685:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587132.253688:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587132.253789:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845edc00 x1875469127562496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587132.253804:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127562496:0@lo:400:kworker.0 00010000:00080000:3.0:1788587132.253816:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845ed180 x1875469127563008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587132.253825:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127563008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587132.253836:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127562368:0@lo:400:kworker.0 00010000:00080000:3.0:1788587132.253845:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845ed500 x1875469127562880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587132.253853:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127562880:0@lo:400:kworker.0 00010000:00010000:2.0:1788587132.313758:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587132.629802:0:19063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788587133.332677:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788587133.508382:0:19115:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788587133.508747:0:19115:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788587133.781545:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587133.781568:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127563136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587133.781630:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587133.781657:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563136 00000100:00100000:2.0:1788587133.781666:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563136 00000100:00100000:2.0:1788587133.781718:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587133.781728:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127563136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587133.781760:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788587133.781823:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127563136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587133.781830:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587133.781884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127563136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587133.782139:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127563264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587133.782166:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587133.782225:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563264 00000100:00100000:2.0:1788587133.782229:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563264 00000100:00100000:2.0:1788587133.782250:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587133.782255:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127563264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587133.782270:0:17931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788587133.784169:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127563264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1906us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587133.784182:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587133.784557:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127563264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788587134.364029:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788587134.399940:0:19165:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587134.400193:0:19165:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788587135.380690:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587135.829632:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587136.408933:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587137.364563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587137.364568:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587137.364571:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587137.364575:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587137.364596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587137.364609:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587137.364619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587137.364622:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587137.364667:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127563520:0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.364730:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587137.364795:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127564032:0@lo:400:kworker.0 00000100:00100000:2.0:1788587137.364811:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127563648:0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.364837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587137.364860:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587137.364868:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788587137.364878:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127563392:0@lo:400:kworker.0 00000100:00100000:2.0:1788587137.364886:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127564160:0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.364916:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587137.364921:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587137.364957:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127563904:0@lo:400:kworker.0 00000100:00100000:2.0:1788587137.364957:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587137.364966:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a845efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127563776:0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.364995:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587137.365000:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587137.365034:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563520 00000100:00100000:2.0:1788587137.365036:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564032 00000100:00100000:3.0:1788587137.365043:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563520 00000100:00100000:2.0:1788587137.365043:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564032 00000100:00100000:2.0:1788587137.365083:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563648 00000100:00100000:3.0:1788587137.365086:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563776 00000100:00100000:2.0:1788587137.365088:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563648 00000100:00100000:3.0:1788587137.365092:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563776 00000100:00100000:2.0:1788587137.365106:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564160 00000100:00100000:2.0:1788587137.365110:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564160 00000100:00100000:3.0:1788587137.365120:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587137.365131:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563904 00000100:00100000:3.0:1788587137.365132:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127563520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587137.365135:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563904 00000100:00100000:2.0:1788587137.365151:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587137.365158:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127564032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365199:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127563520:12345-0@lo:400:kworker.0 Request processed in 70us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587137.365206:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127564032:12345-0@lo:400:kworker.0 Request processed in 46us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587137.365213:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587137.365220:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587137.365237:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587137.365241:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587137.365249:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127563776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365287:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127563776:12345-0@lo:400:kworker.0 Request processed in 42us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587137.365293:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587137.365327:0:17193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788587137.365333:0:17193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788587137.365343:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788587137.365350:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587137.365355:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127564160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365386:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127564160:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587137.365391:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587137.365402:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788587137.365407:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587137.365411:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127563904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365460:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127563904:12345-0@lo:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587137.365465:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587137.365481:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127563392 00000100:00100000:3.0:1788587137.365485:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127563392 00000100:00100000:3.0:1788587137.365522:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788587137.365527:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:3647:x1875469127563392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365557:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:3647:x1875469127563392:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587137.365564:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788587137.365587:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587137.365591:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587137.365613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127563392:0@lo:400:kworker.0 00010000:00080000:3.0:1788587137.365626:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845ef100 x1875469127563904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587137.365637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127563904:0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365655:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127563520:0@lo:400:kworker.0 00010000:00080000:3.0:1788587137.365664:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845ed500 x1875469127564032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587137.365672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127564032:0@lo:400:kworker.0 00000100:00100000:3.0:1788587137.365784:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127563776:0@lo:400:kworker.0 00010000:00080000:3.0:1788587137.365794:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845ece00 x1875469127564160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587137.365802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127564160:0@lo:400:kworker.0 00000100:00100000:2.0:1788587137.366073:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127563648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587137.366122:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127563648:12345-0@lo:400:kworker.0 Request processed in 873us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587137.366129:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788587137.368445:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a845edc00 x1875469127563648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587137.368464:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a845edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127563648:0@lo:400:kworker.0 00010000:00010000:3.0:1788587137.432451:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587138.452625:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587138.452698:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587123/real 1788587123] req@ffff8f5a84465f80 x1875469127556480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587138.452724:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84465f80 x1875469127556480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587138.452734:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587123/real 1788587123] req@ffff8f5a84466300 x1875469127556608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587138.452746:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84466300 x1875469127556608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587138.452766:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cff800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587138.452806:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587138.452810:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127556480:0@lo:8:kworker.0 00000100:00080000:3.0:1788587138.452816:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587138.452821:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587138.452824:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127556608:0@lo:8:kworker.0 00000100:00100000:0.0:1788587138.452963:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127564288:0@lo:400:kworker.0 00000100:00100000:0.0:1788587138.453036:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587138.453198:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587138.453202:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587138.453211:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587138.453215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587138.453275:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564288 00000100:00100000:3.0:1788587138.453283:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564288 00000100:00100000:3.0:1788587138.453325:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788587138.453335:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:3649:x1875469127564288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587138.453405:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127564672:0@lo:400:kworker.0 00000100:00100000:1.0:1788587138.453454:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587138.455594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587138.455603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587138.455606:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cff800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587138.455613:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788587138.455619:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587138.455627:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f5bb4cff800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587138.455663:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5ba7aa5500 x1875469127564800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587138.455684:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587138.455687:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587138.455689:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587138.455692:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788587138.455695:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587138.455698:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f5bbfa54800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:2.0:1788587138.455710:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5ba7aa4380 x1875469127564928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587138.455772:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127564416:0@lo:400:kworker.0 00000100:00100000:2.0:1788587138.455829:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587138.455857:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127565184:0@lo:400:kworker.0 00000100:00100000:2.0:1788587138.455883:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587138.455914:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788587138.455921:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127564544:0@lo:400:kworker.0 00000100:00100000:2.0:1788587138.455956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587138.457329:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:3649:x1875469127564288:12345-0@lo:400:kworker.0 Request processed in 3989us (4287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587138.457342:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788587138.457409:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564672 00000100:00100000:3.0:1788587138.457441:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564672 00000100:00100000:3.0:1788587138.457496:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564416 00000100:00100000:3.0:1788587138.457500:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564416 00000100:00100000:3.0:1788587138.457515:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587138.457522:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127564672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587138.457582:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127564672:12345-0@lo:400:kworker.0 Request processed in 59us (4127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587138.457588:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587138.457599:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587138.457605:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127564416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587138.457634:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127564416:12345-0@lo:400:kworker.0 Request processed in 30us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587138.457639:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788587138.457861:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127565312:0@lo:400:kworker.0 00000100:00100000:3.0:1788587138.460322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127564672:0@lo:400:kworker.0 00000100:00100000:3.0:1788587138.460353:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587138.460363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127565056:0@lo:400:kworker.0 00000100:00100000:3.0:1788587138.460436:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587138.460506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127564800:0@lo:8:kworker.0 00000100:00100000:3.0:1788587138.460538:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587138.460576:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127564928:0@lo:8:kworker.0 00000100:00100000:3.0:1788587138.460597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587138.460632:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564800 00000100:00100000:3.0:1788587138.460637:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564800 00000100:00100000:3.0:1788587138.460661:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564928 00000100:00100000:3.0:1788587138.460664:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564928 00000100:00100000:3.0:1788587138.460676:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587138.460682:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875469127564800:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587138.460710:0:18698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1788587138.460736:0:18698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdac3d 00002000:00100000:3.0:1788587138.460748:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f5a83ce7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788587138.460752:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788587138.460755:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788587138.462030:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565184 00000100:00100000:1.0:1788587138.462041:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565184 00000100:00100000:1.0:1788587138.462096:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127564544 00000100:00100000:1.0:1788587138.462099:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127564544 00000100:00100000:1.0:1788587138.462111:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565056 00000100:00100000:1.0:1788587138.462114:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565056 00000100:00100000:1.0:1788587138.462127:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587138.462135:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127565184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587138.462201:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127565184:12345-0@lo:400:kworker.0 Request processed in 66us (6316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587138.462208:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587138.462222:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587138.462229:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127564544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587138.462257:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127564544:12345-0@lo:400:kworker.0 Request processed in 28us (6300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587138.462263:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587138.462273:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587138.462279:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127565056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587138.462312:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127565056:12345-0@lo:400:kworker.0 Request processed in 34us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587138.462318:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788587138.462370:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa7b80 x1875469127565056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587138.462384:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127565056:0@lo:400:kworker.0 00000100:00100000:0.0:1788587138.462591:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bf956867-663d-4ecf-b775-8366b2c643ae:3649:1875469127564288:0@lo:400:kworker.0 00000100:00100000:2.0:1788587138.462878:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587138.463074:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127564416:0@lo:400:kworker.0 00010000:00080000:2.0:1788587138.463088:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa7100 x1875469127565184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.463097:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127565184:0@lo:400:kworker.0 00010000:00080000:2.0:1788587138.463117:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa4700 x1875469127564544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.463125:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127564544:0@lo:400:kworker.0 00002000:00080000:3.0:1788587138.465135:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788587138.465174:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8f5a83ce0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587138.465272:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875469127564800:12345-0@lo:8:kworker.0 Request processed in 4588us (4731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587138.465283:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587138.465315:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587138.465321:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875469127564928:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788587138.465354:0:18698:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788587138.466607:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa5500 x1875469127564800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.466621:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587138.466630:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788587138.466638:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587138.466644:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788587138.466646:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cff800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788587138.466666:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587138.466671:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127564800:0@lo:8:kworker.0 00000004:00080000:2.0:1788587138.466734:0:17933:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788587138.466755:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17933:1875469127565568:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788587138.466798:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587138.466822:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587138.466849:0:18697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587138.466856:0:18697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788587138.466869:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587138.466879:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127565440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587138.467127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587138.467217:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565312 00000100:00100000:1.0:1788587138.467224:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565312 00000100:00100000:1.0:1788587138.467274:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587138.467284:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127565312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587138.467332:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127565312:12345-0@lo:400:kworker.0 Request processed in 50us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587138.467339:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587138.467410:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565440 00000100:00100000:0.0:1788587138.467442:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565440 00000100:00100000:0.0:1788587138.467491:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587138.467499:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875469127565440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587138.467518:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788587138.467553:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875469127565440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587138.467559:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788587138.467653:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa6d80 x1875469127565312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.467664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127565312:0@lo:400:kworker.0 00010000:00080000:2.0:1788587138.467688:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81093800 x1875469127565440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.467701:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127565440:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788587138.467752:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788587138.467803:0:17932:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788587138.468517:0:17932:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 484399100048ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788587138.468525:0:17932:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788587138.470755:0:17923:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788587138.472708:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565568 00000100:00100000:2.0:1788587138.472720:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565568 00000100:00100000:0.0:1788587138.473104:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587138.473116:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17933:x1875469127565568:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788587138.479682:0:19394:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788587138.479692:0:19394:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788587138.479778:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17933:x1875469127565568:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6661us (12976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587138.479787:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788587138.480082:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81090e00 x1875469127565568/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.480097:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17933:1875469127565568:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788587138.480111:0:17933:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788587138.480150:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17933:1875469127565696:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788587138.480183:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587138.480214:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587138.480305:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565696 00000100:00100000:0.0:1788587138.480312:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565696 00000100:00100000:0.0:1788587138.480356:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587138.480364:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17933:x1875469127565696:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788587138.480388:0:18697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788587138.480442:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17933:x1875469127565696:12345-0@lo:5:osp-pre-0-1.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587138.480448:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788587138.480535:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81090e00 x1875469127565696/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587138.480546:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17933:1875469127565696:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788587138.480555:0:17933:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788587138.480591:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17933:1875469127565824:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788587138.480616:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587138.480640:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587138.480703:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565824 00000100:00100000:0.0:1788587138.480708:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565824 00000100:00100000:0.0:1788587138.480736:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587138.480741:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17933:x1875469127565824:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788587138.480764:0:19394:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788587138.503071:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875469127564928:12345-0@lo:8:kworker.0 Request processed in 37742us (42466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587138.503084:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788587138.503593:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587138.503601:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587138.503605:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127564928:0@lo:8:kworker.0 00000001:00080000:2.0:1788587138.506352:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788587138.506453:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788587138.506660:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17933:x1875469127565824:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25915us (26040us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788587138.506674:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788587138.507065:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a81090e00 x1875469127565824/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587154 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587138.507078:0:17933:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788587138.507084:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17933:1875469127565824:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788587138.507099:0:17933:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788587138.507148:0:17933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17933:1875469127565952:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788587138.507187:0:17933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587138.507221:0:17933:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9868c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587138.507317:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127565952 00000100:00100000:1.0:1788587138.507324:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127565952 00000100:00100000:1.0:1788587138.507369:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587138.507380:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1875469127565952:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788587138.507454:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1875469127565952:12345-0@lo:900:osp-pre-0-1.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587138.507461:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788587138.508022:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a84466d80 x1875469127565952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587154 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587138.508034:0:17933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17933:1875469127565952:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788587138.902228:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587138.902251:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127566080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587138.902338:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587138.902386:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566080 00000100:00100000:1.0:1788587138.902394:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566080 00000100:00100000:1.0:1788587138.902452:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788587138.902461:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127566080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587138.902519:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587138.902562:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127566080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587138.902568:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788587138.902611:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127566080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587138.908195:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587138.908217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127566208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587138.908281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587138.908323:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566208 00000100:00100000:0.0:1788587138.908329:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566208 00000100:00100000:0.0:1788587138.908375:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587138.908384:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127566208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587138.908437:0:17931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788587138.908503:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127566208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587138.908520:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587138.908561:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127566208:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788587139.480251:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587140.429279:0:19512:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587140.429282:0:19512:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788587140.429284:0:19512:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788587140.429387:0:19512:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f5a83ce1000 00000020:01000004:3.0:1788587140.429402:0:19512:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788587140.430328:0:19512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788587140.430346:0:19512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f5bb4c999c0) 00000020:00000080:3.0:1788587140.430365:0:19512:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788587140.500615:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788587140.520899:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788587140.524540:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788587140.529235:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788587140.529545:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788587140.529841:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788587140.530351:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788587140.530789:0:19512:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788587140.534046:0:19512:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788587140.534266:0:19512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788587140.534280:0:19512:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788587140.534291:0:19512:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfbc93bbea5fdac4b 00000020:01000004:1.0:1788587140.534299:0:19512:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788587140.534320:0:19512:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.101@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788587140.534324:0:19512:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788587140.534330:0:19512:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788587140.534366:0:19512:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788587140.534371:0:19512:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788587140.556070:0:19512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788587140.556115:0:19512:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.101@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788587140.556120:0:19512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788587140.556121:0:19512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587140.556123:0:19512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587140.556124:0:19512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587140.556125:0:19512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587140.556127:0:19512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587140.556128:0:19512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587140.556130:0:19512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587140.556131:0:19512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587140.556135:0:19512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788587140.556137:0:19512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587140.556139:0:19512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587140.556140:0:19512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587140.556141:0:19512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587140.556142:0:19512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587140.556143:0:19512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587140.556144:0:19512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587140.556146:0:19512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587140.556147:0:19512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587140.556175:0:19512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788587140.556195:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566336:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587140.556270:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.556317:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9871f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587140.556516:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566336 00000100:00100000:3.0:1788587140.556526:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566336 00000100:00100000:3.0:1788587140.556807:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788587140.556817:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:19512:x1875469127566336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587140.556849:0:17185:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788587140.556852:0:17185:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788587140.556856:0:17185:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788587140.559031:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+21:19512:x1875469127566336:12345-0@lo:253:mount.lustre.0 Request processed in 2209us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.559044:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788587140.559157:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587140.559172:0:19512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788587140.559174:0:19512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587140.559176:0:19512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587140.559177:0:19512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587140.559179:0:19512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587140.559180:0:19512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587140.559181:0:19512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587140.559182:0:19512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587140.559184:0:19512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587140.559185:0:19512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788587140.559214:0:19512:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f5a83ce1000 from lustre-OST0001 10000000:01000000:1.0:1788587140.559242:0:19512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788587140.559245:0:19512:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788587140.559253:0:19512:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f5a83343380 local copy 00010000:00010000:1.0:1788587140.559263:0:19512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587140.559358:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587140.559398:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.562790:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587140.563211:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566464 00000100:00100000:2.0:1788587140.563223:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566464 00000100:00100000:3.0:1788587140.563307:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788587140.563318:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:19512:x1875469127566464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587140.563542:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:19512:x1875469127566464:12345-0@lo:501:mount.lustre.0 Request processed in 225us (4142us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587140.563550:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587140.563795:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566464:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788587140.563815:0:19512:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788587140.563841:0:19512:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788587140.563854:0:19512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.563865:0:19512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70c00/0xfbc93bbea5fda965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fda96c expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587140.563897:0:19512:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f5a83ce1000 10000000:01000000:1.0:1788587140.563902:0:19512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788587140.563908:0:19512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788587140.563914:0:19512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587140.563919:0:19512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788587140.563922:0:19512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788587140.563951:0:19512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.563958:0:19512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.563979:0:19512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587140.563999:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587140.564037:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.564070:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587140.564259:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566592 00000100:00100000:3.0:1788587140.564264:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566592 00000100:00100000:3.0:1788587140.564301:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788587140.564315:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:19512:x1875469127566592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587140.564325:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587140.564337:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdac59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdac52 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.564360:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdac59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac52 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.564371:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1b000/0xfbc93bbea5fdac59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac52 expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.564378:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1b000, rc 0) 00000100:00100000:3.0:1788587140.564562:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566592:12345-0@lo:101:mount.lustre.0 Request processed in 238us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.564569:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788587140.564916:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587140.565036:0:19512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac59 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.565047:0:19512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdac59 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587140.566799:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788587140.567545:0:19512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587140.569770:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788587140.569830:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788587140.569848:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788587140.569862:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788587140.569874:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788587140.569886:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788587140.569908:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788587140.569914:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788587140.570012:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587140.570063:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.570103:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587140.570443:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566720 00000100:00100000:3.0:1788587140.570451:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566720 00000100:00100000:3.0:1788587140.570510:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788587140.570521:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587140.570767:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566720:12345-0@lo:501:mount.lustre.0 Request processed in 247us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.570775:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788587140.570797:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587140.570831:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587140.570881:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587140.570911:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8245aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587140.571266:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566848 00000100:00100000:3.0:1788587140.571272:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566848 00000100:00100000:3.0:1788587140.571312:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788587140.571319:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587140.572130:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566848:12345-0@lo:503:mount.lustre.0 Request processed in 807us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.572149:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587140.572260:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587140.580310:0:19512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587140.581870:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587140.581953:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587140.581996:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5baaa4a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.582005:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127566976 00000100:00100000:1.0:1788587140.582012:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127566976 00000100:00100000:1.0:1788587140.582073:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788587140.582083:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587140.582908:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127566976:12345-0@lo:502:mount.lustre.0 Request processed in 823us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.582917:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788587140.583028:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127566976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587140.583260:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788587140.583291:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788587140.583307:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788587140.583321:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788587140.583335:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788587140.583349:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788587140.583364:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788587140.583378:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788587140.583856:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788587140.583899:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587140.583954:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.584041:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587140.584087:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567104 00000100:00100000:3.0:1788587140.584094:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567104 00000100:00100000:3.0:1788587140.584142:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788587140.584151:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127567104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587140.584351:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127567104:12345-0@lo:502:mount.lustre.0 Request processed in 199us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.584358:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788587140.584795:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587140.584969:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788587140.584981:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788587140.590986:0:19516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587140.590998:0:19516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788587140.591005:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587140.591007:0:19516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788587140.591015:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587140.591030:0:19516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f5b85b8cd40) 00000020:00000080:1.0:1788587140.591055:0:19516:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788587140.591060:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788587140.591157:0:19516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a83ce1000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788587140.591167:0:19516:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788587140.591173:0:19516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xfbc93bbea5fdac67 00010000:00010000:1.0:1788587140.595191:0:19516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788587140.595812:0:19516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788587140.597210:0:19516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788587140.598605:0:19516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788587140.598616:0:19516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587140.598622:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587140.598630:0:19516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788587140.598634:0:19516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587140.598639:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587140.598640:0:19516:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587140.598643:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587140.598645:0:19516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587140.598647:0:19516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587140.598649:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587140.598651:0:19516:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788587140.598653:0:19516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587140.598655:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587140.598656:0:19516:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587140.598660:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788587140.598685:0:19516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587140.598688:0:19516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587140.598689:0:19516:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587140.598692:0:19516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788587140.598848:0:19512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788587140.598872:0:19512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788587140.598892:0:19512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac59 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587140.598904:0:19512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466400/0xfbc93bbea5fdac52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac59 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587140.598913:0:19512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a83ce1000 from 1 10000000:01000000:2.0:1788587140.598916:0:19512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587140.598949:0:19512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587140.598956:0:19512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587140.598967:0:19512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587140.599000:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587140.599065:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.599096:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b87fc2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.599263:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567232 00000100:00100000:1.0:1788587140.599270:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567232 00000100:00100000:1.0:1788587140.599314:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788587140.599323:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+22:19512:x1875469127567232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587140.599334:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587140.599346:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdac6e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.599368:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.599378:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.599386:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a467200, rc 0) 00000100:00100000:1.0:1788587140.599460:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567232:12345-0@lo:101:mount.lustre.0 Request processed in 138us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.599466:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587140.599557:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a81090380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587140.599571:0:19512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.599591:0:19512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587140.600657:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788587140.600902:0:19512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587140.601082:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788587140.601106:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788587140.601123:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788587140.601129:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788587140.601191:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587140.601243:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.601290:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.601509:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567360 00000100:00100000:1.0:1788587140.601516:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567360 00000100:00100000:1.0:1788587140.601553:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788587140.601562:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587140.601682:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567360:12345-0@lo:501:mount.lustre.0 Request processed in 120us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.601689:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587140.601844:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587140.601872:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587140.601912:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.601939:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587140.601980:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567488 00000100:00100000:2.0:1788587140.601985:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567488 00000100:00100000:2.0:1788587140.602015:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788587140.602021:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587140.602093:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567488:12345-0@lo:503:mount.lustre.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.602099:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587140.602163:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567488:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587140.602740:0:19512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587140.602801:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587140.602840:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.602911:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9868ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587140.602945:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567616 00000100:00100000:2.0:1788587140.602950:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567616 00000100:00100000:2.0:1788587140.603010:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587140.603017:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587140.603103:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567616:12345-0@lo:502:mount.lustre.0 Request processed in 86us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.603110:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788587140.603172:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587140.603329:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788587140.603352:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788587140.603365:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788587140.603377:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788587140.603405:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788587140.603440:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788587140.603456:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788587140.603479:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788587140.603493:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788587140.603504:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788587140.603515:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788587140.603537:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587140.603571:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.603817:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567744 00000100:00100000:3.0:1788587140.603822:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567744 00000100:00100000:3.0:1788587140.603847:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788587140.603854:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587140.603939:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567744:12345-0@lo:502:mount.lustre.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.603946:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788587140.604042:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b9868ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.604058:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587140.604101:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788587140.604109:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788587140.604944:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587140.604954:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.604956:0:19519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788587140.604962:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5a83ce1000 00000020:00000080:3.0:1788587140.604964:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587140.604972:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587140.604974:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.604975:0:19519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788587140.604978:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587140.604980:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.604982:0:19519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788587140.604985:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f5a83ce1000 00000020:00000080:3.0:1788587140.604987:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587140.605031:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587140.605034:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.605040:0:19519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788587140.605043:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587140.605045:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.605047:0:19519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587140.605050:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5a83ce1000 00000020:00000080:3.0:1788587140.605052:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587140.605069:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587140.605072:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.605073:0:19519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587140.605076:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587140.605078:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.605079:0:19519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788587140.605082:0:19519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f5a83ce1000 00000020:00000080:3.0:1788587140.605084:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587140.605104:0:19519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587140.605108:0:19519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587140.605109:0:19519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788587140.605112:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788587140.605247:0:19512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788587140.605271:0:19512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587140.606398:0:19512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.606412:0:19512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587140.606501:0:19512:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788587140.606505:0:19512:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f5a83ce1000 10000000:01000000:1.0:1788587140.606508:0:19512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f5a83ce1000 10000000:01000000:1.0:1788587140.606512:0:19512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587140.606517:0:19512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f5a83ce1000 from 1 10000000:01000000:1.0:1788587140.606520:0:19512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587140.606556:0:19512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.606564:0:19512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.606575:0:19512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587140.606617:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587140.606678:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.606717:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a826166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587140.607291:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127567872 00000100:00100000:3.0:1788587140.607299:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127567872 00000100:00100000:3.0:1788587140.607507:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788587140.607521:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:19512:x1875469127567872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587140.607534:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587140.607548:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdac83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdac7c expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.607568:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdac83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac7c expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.607694:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a83c1b200/0xfbc93bbea5fdac83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac7c expref: 24 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.607712:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a83c1b200, rc 0) 00000100:00100000:3.0:1788587140.607804:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127567872:12345-0@lo:101:mount.lustre.0 Request processed in 285us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.607811:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788587140.607910:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127567872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587140.607926:0:19512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac83 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.607945:0:19512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdac83 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587140.611565:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788587140.612028:0:19512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587140.612208:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788587140.612233:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788587140.612247:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788587140.612260:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788587140.612287:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788587140.612301:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788587140.612312:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788587140.612324:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788587140.612335:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788587140.612348:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788587140.612362:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788587140.612375:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788587140.613750:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788587140.613790:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788587140.613804:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788587140.613817:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788587140.613830:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788587140.613844:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788587140.613857:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788587140.613870:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788587140.613897:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788587140.613912:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788587140.613925:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788587140.613939:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788587140.613953:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788587140.613966:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788587140.613990:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788587140.614006:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788587140.614019:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788587140.614033:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788587140.614046:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788587140.614059:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788587140.614074:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788587140.614088:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788587140.614101:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788587140.614113:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788587140.614141:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788587140.614157:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788587140.614170:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788587140.614183:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788587140.614195:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788587140.614209:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788587140.614221:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788587140.614235:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788587140.614249:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788587140.614261:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788587140.614285:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788587140.614292:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788587140.616729:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587140.616799:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.616839:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568000 00000100:00100000:1.0:1788587140.616846:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568000 00000100:00100000:1.0:1788587140.616883:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788587140.616890:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587140.617000:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568000:12345-0@lo:501:mount.lustre.0 Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.617017:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788587140.617053:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.617239:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587140.617276:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587140.617309:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.619624:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587140.620550:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568128 00000100:00100000:2.0:1788587140.620560:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568128 00000100:00100000:2.0:1788587140.620706:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788587140.620715:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587140.620866:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568128:12345-0@lo:503:mount.lustre.0 Request processed in 152us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.620873:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788587140.620949:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587140.621383:0:19512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587140.621498:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587140.621538:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587140.621567:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba0554cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.621737:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568256 00000100:00100000:1.0:1788587140.621743:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568256 00000100:00100000:1.0:1788587140.621771:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587140.621777:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587140.621863:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568256:12345-0@lo:502:mount.lustre.0 Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.621870:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788587140.621882:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587140.622193:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788587140.622221:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788587140.622237:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788587140.622250:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788587140.622264:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788587140.622276:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788587140.622290:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788587140.622302:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788587140.622314:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788587140.622326:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788587140.622338:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788587140.622351:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788587140.622364:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788587140.622377:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788587140.622391:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788587140.622405:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788587140.622465:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788587140.622496:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788587140.622510:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788587140.622522:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788587140.622534:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788587140.622545:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788587140.622558:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788587140.622572:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788587140.622669:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788587140.622685:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788587140.622700:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788587140.622713:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788587140.622725:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788587140.622738:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788587140.622751:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788587140.622764:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788587140.622778:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788587140.622792:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788587140.622806:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788587140.622819:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788587140.622832:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788587140.622845:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788587140.622858:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788587140.622870:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788587140.622881:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788587140.622894:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788587140.622921:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788587140.623019:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788587140.623036:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788587140.623051:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788587140.623065:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788587140.623079:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788587140.625434:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587140.625523:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.630773:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b891c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.631056:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568384 00000100:00100000:1.0:1788587140.631065:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568384 00000100:00100000:1.0:1788587140.631154:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788587140.631175:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587140.631334:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568384:12345-0@lo:502:mount.lustre.0 Request processed in 170us (5810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.631342:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788587140.631393:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587140.631731:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788587140.631761:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788587140.631794:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587140.631844:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587140.638306:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568512 00000100:00100000:3.0:1788587140.638311:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b8684f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587140.638320:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568512 00000100:00100000:0.0:1788587140.638360:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788587140.638369:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587140.638540:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127568512:12345-0@lo:502:mount.lustre.0 Request processed in 172us (6695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587140.638547:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788587140.639826:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127568512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587140.639921:0:19512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788587140.640677:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788587140.644055:0:19525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788587140.644073:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f5b85b8b380) 00000020:00000080:1.0:1788587140.644096:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788587140.644204:0:19525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a83ce1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587140.644208:0:19525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5a83ce1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587140.644211:0:19525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5a83ce1000 3 00010000:00080000:1.0:1788587140.644253:0:19525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a81b38000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788587140.649457:0:19525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788587140.649840:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788587140.649881:0:19525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587140.649894:0:19525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xfbc93bbea5fdac91 00000100:00080000:1.0:1788587140.649903:0:19525:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587140.649909:0:19525:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f5a81b38000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587140.649942:0:19525:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e35880 x1875469127568640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587140.649972:0:19525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788587140.650049:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127568640:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587140.650122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.650304:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568640 00000100:00100000:1.0:1788587140.650312:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568640 00000100:00100000:1.0:1788587140.650343:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587140.650351:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875469127568640:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788587140.650372:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1788587140.650398:0:17193:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xfbc93bbea5fdac98 00000004:00100000:1.0:1788587140.650412:0:17193:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587140.650477:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8f5a81b3f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587140.650538:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875469127568640:12345-0@lo:38:llog_process_th.0 Request processed in 186us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.650545:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788587140.650745:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb4e35880 x1875469127568640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587140.650756:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587140.650762:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788587140.650769:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587140.650773:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788587140.650775:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a81b38000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587140.650780:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875469127568640:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788587140.651012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587140.651016:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587140.651019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587140.651022:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587140.651051:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788587140.651052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587140.651055:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788587140.651058:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587140.651062:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 484 00000100:00100000:2.0:1788587140.651062:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127569152:0@lo:400:kworker.0 00000100:00080000:3.0:1788587140.651065:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788587140.651070:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f5bbfa54800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:3.0:1788587140.651083:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5ba7aa6d80 x1875469127569280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587140.651094:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.651115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127568768:0@lo:400:kworker.0 00000100:00100000:2.0:1788587140.651136:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.651154:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587140.651159:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127569408:0@lo:400:kworker.0 00000100:00100000:2.0:1788587140.651178:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.651201:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127569024:0@lo:400:kworker.0 00000100:00100000:2.0:1788587140.651222:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.651223:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127568896:0@lo:400:kworker.0 00000100:00100000:2.0:1788587140.651237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127569664:0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.651249:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.651258:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127569280:0@lo:8:kworker.0 00000100:00100000:3.0:1788587140.651273:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127569536:0@lo:400:kworker.0 00000100:00100000:2.0:1788587140.651277:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.651290:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.651304:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569152 00000100:00100000:2.0:1788587140.651309:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569152 00000100:00100000:3.0:1788587140.651311:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569408 00000100:00100000:3.0:1788587140.651314:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569408 00000100:00100000:3.0:1788587140.651336:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568896 00000100:00100000:3.0:1788587140.651344:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568896 00000100:00100000:2.0:1788587140.651345:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569280 00000100:00100000:2.0:1788587140.651347:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569280 00000100:00100000:3.0:1788587140.651357:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569536 00000100:00100000:3.0:1788587140.651360:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569536 00000100:00100000:2.0:1788587140.651361:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587140.651367:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.651371:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587140.651376:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127569408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.651405:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127569408:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.651412:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788587140.651442:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587140.651447:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127568896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.651490:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127568896:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.651495:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788587140.651504:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587140.651509:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127569536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.651531:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127569536:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.651536:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788587140.651770:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5a83108700 x1875469127568896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587140.651782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127568896:0@lo:400:kworker.0 00010000:00080000:3.0:1788587140.651792:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa4700 x1875469127569536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587140.651800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127569536:0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.653757:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587140.653780:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875469127569280:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788587140.653879:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875469127569280:12345-0@lo:8:kworker.0 Request processed in 100us (2599us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788587140.653886:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587140.653917:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.653980:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569664 00000100:00100000:3.0:1788587140.653987:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569664 00000100:00100000:3.0:1788587140.654032:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587140.654038:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.654082:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875469127569664:12345-0@lo:400:kworker.0 Request processed in 44us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.654088:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587140.654107:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127568768 00000100:00100000:3.0:1788587140.654110:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127568768 00000100:00100000:3.0:1788587140.654454:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569024 00000100:00100000:3.0:1788587140.654458:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569024 00000100:00100000:3.0:1788587140.654486:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587140.654493:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.654588:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587140.655929:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.656000:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127569024:12345-0@lo:400:kworker.0 Request processed in 95us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587140.656008:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587140.658844:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127569152:12345-0@lo:400:kworker.0 Request processed in 7467us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.658858:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788587140.658899:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587140.658905:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587140.658908:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788587140.659093:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa5500 x1875469127569408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587140.659108:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127569408:0@lo:400:kworker.0 00010000:00080000:2.0:1788587140.659122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa4380 x1875469127569152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587140.659131:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127569152:0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.659231:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127568768:12345-0@lo:400:kworker.0 Request processed in 4736us (8091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.659241:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587140.660202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127569024:0@lo:400:kworker.0 00010000:00080000:3.0:1788587140.660217:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5ba7aa7100 x1875469127569664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587140.660227:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875469127569664:0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.660512:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587140.660529:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587140.660534:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788587140.660539:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127569280:0@lo:8:kworker.0 00000020:01000004:1.0:1788587140.660747:0:19525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788587140.660763:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f5b85b88000) 00000020:00000080:1.0:1788587140.660785:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788587140.660861:0:19525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f5a83ce1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587140.660864:0:19525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f5a83ce1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788587140.660867:0:19525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f5a83ce1000 3 00010000:00080000:1.0:1788587140.660893:0:19525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f5a81b39000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.101@tcp at head 00010000:00010000:1.0:1788587140.662490:0:19525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788587140.662724:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788587140.662764:0:19525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587140.662775:0:19525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xfbc93bbea5fdaca6 00000100:00080000:1.0:1788587140.662784:0:19525:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587140.662789:0:19525:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f5a81b39000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:1.0:1788587140.662823:0:19525:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5bb4e36a00 x1875469127569792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587140.662847:0:19525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788587140.662928:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875469127569792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587140.662993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587140.663461:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127568768:0@lo:400:kworker.0 00000100:00100000:1.0:1788587140.663548:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569792 00000100:00100000:1.0:1788587140.663554:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569792 00000100:00100000:1.0:1788587140.663746:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587140.663753:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875469127569792:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788587140.663780:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1788587140.663821:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xfbc93bbea5fdacad 00000004:00100000:1.0:1788587140.663836:0:17191:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587140.663869:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8f5a81b3b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587140.664192:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875469127569792:12345-0@lo:38:llog_process_th.0 Request processed in 436us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.664201:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788587140.664221:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f5bb4e36a00 x1875469127569792/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587140.664233:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788587140.664239:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788587140.664247:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788587140.664251:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788587140.664254:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5a81b39000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788587140.664259:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875469127569792:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788587140.664523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587140.664528:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587140.664532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587140.664534:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788587140.665860:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788587140.665976:0:19512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788587140.666012:0:19512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587140.666034:0:19512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac83 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.666045:0:19512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466200/0xfbc93bbea5fdac7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdac83 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587140.666094:0:19512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587140.666096:0:19512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587140.666097:0:19512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587140.666098:0:19512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587140.666100:0:19512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587140.666101:0:19512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587140.666102:0:19512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587140.666104:0:19512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587140.666105:0:19512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587140.666110:0:19512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788587140.666112:0:19512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587140.666113:0:19512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587140.666115:0:19512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587140.666116:0:19512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587140.666117:0:19512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587140.666119:0:19512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587140.666120:0:19512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587140.666121:0:19512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587140.666122:0:19512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587140.666147:0:19512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587140.666235:0:19512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127569920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587140.666302:0:19512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.666553:0:19512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b891c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587140.668066:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127569920 00000100:00100000:0.0:1788587140.668077:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127569920 00000100:00100000:0.0:1788587140.668136:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587140.668146:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127569920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587140.668176:0:17184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587140.668189:0:17184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788587140.670865:0:17184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788587140.670882:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788587140.671216:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:19512:x1875469127569920:12345-0@lo:253:mount.lustre.0 Request processed in 3067us (4909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.671230:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788587140.671318:0:19512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bf956867-663d-4ecf-b775-8366b2c643ae:19512:1875469127569920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587140.671334:0:19512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788587140.671338:0:19512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587140.671351:0:19512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587140.671352:0:19512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587140.671353:0:19512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587140.671354:0:19512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587140.671355:0:19512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587140.671357:0:19512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587140.671358:0:19512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587140.671360:0:19512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587140.671374:0:19512:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788587140.672884:0:17207:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788587140.672892:0:17207:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788587140.675093:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.675139:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.675146:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.675153:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.675196:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.675212:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 23 pid: 17184 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587140.675228:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127570048:0@lo:104: 00000100:00100000:3.0:1788587140.675290:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587140.675358:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.675367:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 23 pid: 17185 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587140.675373:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570048 00000100:00100000:3.0:1788587140.675377:0:17207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127570176:0@lo:104: 00000100:00100000:1.0:1788587140.675382:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570048 00000100:00100000:3.0:1788587140.675402:0:17207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.675458:0:17207:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b916dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587140.675485:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570176 00000100:00100000:1.0:1788587140.675489:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570176 00000100:00100000:1.0:1788587140.675503:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587140.675512:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf956867-663d-4ecf-b775-8366b2c643ae+4:17207:x1875469127570048:12345-0@lo:104: 00010000:00010000:1.0:1788587140.675525:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.675579:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788587140.675584:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf956867-663d-4ecf-b775-8366b2c643ae+4:17207:x1875469127570048:12345-0@lo:104: Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.675590:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587140.675604:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587140.675609:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127570176:12345-0@lo:104: 00010000:00010000:1.0:1788587140.675616:0:17174:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587140.675641:0:17174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788587140.675645:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bf956867-663d-4ecf-b775-8366b2c643ae+3:17207:x1875469127570176:12345-0@lo:104: Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.675662:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587140.676448:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127570048:0@lo:104: 00000100:00100000:3.0:1788587140.676461:0:17207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17207:1875469127570176:0@lo:104: 00010000:00010000:3.0:1788587140.676506:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679741:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587140.679756:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679769:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1aa00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587140.679773:0:18723:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679784:0:18723:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587140.679792:0:18723:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587140.679798:0:18723:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587140.679857:0:18723:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679863:0:18723:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587140.679889:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679897:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdac2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac36 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679925:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587140.679929:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679954:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467600 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:3.0:1788587140.679957:0:18723:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.679963:0:18723:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587140.679970:0:18723:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587140.679975:0:18723:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587140.680003:0:18723:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680009:0:18723:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587140.680016:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680023:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdac21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac28 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680038:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587140.680040:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587140.680042:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587140.680066:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127570432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587140.680129:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.680189:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587140.680195:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127570304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587140.680225:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.680254:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570432 00000100:00100000:3.0:1788587140.680260:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570432 00010000:00010000:3.0:1788587140.680290:0:17177:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 24 pid: 17185 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587140.680303:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570304 00000100:00100000:1.0:1788587140.680310:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570304 00000100:00100000:3.0:1788587140.680322:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788587140.680332:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 25 pid: 17184 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587140.680336:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+25:3647:x1875469127570432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587140.680354:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788587140.680358:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788587140.680363:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 25 pid: 17185 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587140.680367:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788587140.680378:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 25 pid: 17185 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680392:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdac28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdac21 expref: 25 pid: 17185 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680405:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587140.680464:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+24:3647:x1875469127570432:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.680483:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587140.680501:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587140.680508:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+23:3647:x1875469127570304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587140.680516:0:17177:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788587140.680518:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127570432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587140.680523:0:17177:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 23 pid: 17184 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680534:0:17177:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 23 pid: 17184 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680551:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bbfa70800/0xfbc93bbea5fdac36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdac2f expref: 23 pid: 17184 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680562:0:17177:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680571:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587140.680583:0:17177:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007692539s 00010000:00010000:3.0:1788587140.680587:0:17177:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680602:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680608:0:17177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680613:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680618:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587140.680621:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680628:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680648:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587140.680664:0:17177:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587140.680687:0:17207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587140.680699:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf956867-663d-4ecf-b775-8366b2c643ae+22:3647:x1875469127570304:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (471us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587140.680708:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587140.680710:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788587140.680721:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1a600/0xfbc93bbea5fdacb4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587140.680822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127570304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587140.683723:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788587140.692321:0:19512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788587140.702826:0:19512:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788587140.702836:0:19512:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788587140.702869:0:19512:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788587140.702920:0:19512:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788587140.702938:0:19512:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788587140.702960:0:19512:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788587140.704285:0:19512:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788587140.708847:0:19512:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788587141.525113:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788587141.560252:0:19578:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587141.560948:0:19578:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788587141.909395:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788587142.548711:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788587142.548719:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5bb05d5000 from 10 10000000:01000000:1.0:1788587142.548725:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587142.548779:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587142.548792:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587142.548803:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587142.548830:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587142.548914:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587142.548964:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b892ad840 going to sleep for 11 seconds 00010000:00010000:3.0:1788587142.548995:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587142.549148:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570560 00000100:00100000:2.0:1788587142.549156:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570560 00000100:00100000:2.0:1788587142.549212:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587142.549221:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+22:17188:x1875469127570560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587142.549233:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587142.549245:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdacc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdacbb expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587142.549268:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdacc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdacbb expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587142.549277:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa71c00/0xfbc93bbea5fdacc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdacbb expref: 23 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587142.549286:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71c00, rc 0) 00000100:00100000:2.0:1788587142.549341:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127570560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587142.549347:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788587142.549652:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587142.549669:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdacc2 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587142.549679:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdacc2 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587142.549756:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587142.549791:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587142.550046:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587142.550087:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570688 00000100:00100000:1.0:1788587142.550093:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570688 00000100:00100000:1.0:1788587142.550133:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587142.550141:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127570688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788587142.550156:0:17184:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587142.550177:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587142.550180:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788587142.550263:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127570688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587142.550270:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788587142.551161:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587142.551247:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587142.551255:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdacc2 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587142.551265:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467600/0xfbc93bbea5fdacbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdacc2 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587142.551274:0:17188:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587142.551277:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f5a8450b800 from 10 10000000:01000000:3.0:1788587142.551280:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587142.551308:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587142.551316:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587142.551326:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587142.551343:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587142.551383:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587142.551476:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587142.551646:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570816 00000100:00100000:1.0:1788587142.551652:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570816 00000100:00100000:1.0:1788587142.551737:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587142.551754:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127570816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587142.551765:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587142.551786:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b8a466000/0xfbc93bbea5fdacd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdacc9 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587142.551806:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b8a466000/0xfbc93bbea5fdacd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdacc9 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587142.551816:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b8a466000/0xfbc93bbea5fdacd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdacc9 expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587142.551825:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b8a466000, rc 0) 00000100:00100000:1.0:1788587142.551868:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127570816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587142.551874:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788587142.552011:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587142.552024:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdacd0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587142.552032:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdacd0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587142.552091:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587142.552121:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587142.563525:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127570944 00000100:00100000:0.0:1788587142.563540:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127570944 00000100:00100000:0.0:1788587142.564198:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788587142.564212:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127570944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587142.564238:0:17184:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587142.564261:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587142.564264:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788587142.564657:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127570944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 446us (12532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587142.564666:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788587142.565306:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbcbac540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587142.565332:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127570944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587142.565518:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587142.565530:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdacd0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587142.565541:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5a83c1aa00/0xfbc93bbea5fdacc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdacd0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587143.509093:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587143.509727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127571072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587143.509798:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587143.510026:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571072 00000100:00100000:0.0:1788587143.510035:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571072 00000100:00100000:0.0:1788587143.516808:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587143.516826:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127571072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587143.516860:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00010000:00080000:3.0:1788587143.517046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465500 x1875469127571072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587143.517068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127571072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587143.517100:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127571072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 219us (7240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587143.517108:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788587143.523412:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788587143.572704:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587144.020575:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127571200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587144.020647:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.020706:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571200 00000100:00100000:1.0:1788587144.020713:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571200 00000100:00100000:1.0:1788587144.020758:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587144.020768:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127571200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587144.020809:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587144.020853:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127571200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.020860:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587144.020917:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127571200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587144.023397:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587144.023723:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127571328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587144.023790:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.024604:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571328 00000100:00100000:1.0:1788587144.024614:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571328 00000100:00100000:1.0:1788587144.024661:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788587144.024670:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127571328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587144.024702:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788587144.024756:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127571328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.024763:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587144.024850:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127571328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788587144.602871:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587144.788612:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587124/real 1788587124] req@ffff8f5a84521500 x1875469127557120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.788656:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5a84521500 x1875469127557120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.788669:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587124/real 1788587124] req@ffff8f5ba7aa7480 x1875469127557248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.788679:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f5ba7aa7480 x1875469127557248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587144.788728:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587144.788744:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587144.788748:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127557120:0@lo:8:kworker.0 00000100:00080000:3.0:1788587144.788753:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587144.788757:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587144.788760:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127557248:0@lo:8:kworker.0 00000100:00100000:3.0:1788587144.789332:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788587144.792912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587144.792919:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788587144.792923:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587144.792931:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:0.0:1788587144.792937:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788587144.792943:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f5bb4f7b000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587144.792964:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84465180 x1875469127571712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587144.792981:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587144.792984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587144.792986:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587144.792989:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:0.0:1788587144.792992:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788587144.792995:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f5bb4cfe000 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587144.793006:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84465500 x1875469127571840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587144.793614:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127571968:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.793698:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.793736:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587144.793743:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127571584:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.793769:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.793803:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571968 00000100:00100000:1.0:1788587144.793810:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571968 00000100:00100000:1.0:1788587144.793866:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587144.793878:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127571968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.793943:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127571968:12345-0@lo:400:kworker.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.793951:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587144.793977:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571584 00000100:00100000:1.0:1788587144.793993:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571584 00000100:00100000:1.0:1788587144.794018:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587144.794026:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127571584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.794067:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127571584:12345-0@lo:400:kworker.0 Request processed in 42us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.794074:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587144.794116:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127571584:0@lo:400:kworker.0 00010000:00080000:1.0:1788587144.794132:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84466d80 x1875469127571968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.794143:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127571968:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.794188:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127571712:0@lo:8:kworker.0 00000100:00100000:1.0:1788587144.794221:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.794248:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127571840:0@lo:8:kworker.0 00000100:00100000:1.0:1788587144.794267:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.796153:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571712 00000100:00100000:3.0:1788587144.796167:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571712 00000100:00100000:3.0:1788587144.796776:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571840 00000100:00100000:3.0:1788587144.796783:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571840 00000100:00100000:3.0:1788587144.796806:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587144.796814:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875469127571712:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587144.796847:0:18697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1788587144.796876:0:18697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fdacd7 00002000:00100000:3.0:1788587144.796890:0:18697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f5a832a5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788587144.796895:0:18697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788587144.796897:0:18697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587144.796969:0:18697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587144.796994:0:18697:0:(import.c:65:import_set_state_nolock()) ffff8f5a832a6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587144.797076:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875469127571712:12345-0@lo:8:kworker.0 Request processed in 260us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.797083:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587144.797100:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587144.797104:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875469127571840:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587144.797131:0:18697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1788587144.797146:0:18697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xfbc93bbea5fdacde 00002000:00100000:3.0:1788587144.797152:0:18697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f5a832a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788587144.797156:0:18697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788587144.797159:0:18697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587144.797952:0:18697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587144.797970:0:18697:0:(import.c:65:import_set_state_nolock()) ffff8f5a832a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587144.798020:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875469127571840:12345-0@lo:8:kworker.0 Request processed in 912us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.798028:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788587144.798083:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465180 x1875469127571712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.798095:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587144.798105:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788587144.798112:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788587144.798118:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788587144.798121:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4f7b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788587144.798192:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788587144.798198:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127571712:0@lo:8:kworker.0 00010000:00080000:3.0:1788587144.798214:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465500 x1875469127571840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.798221:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587144.798225:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788587144.798230:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788587144.798233:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788587144.798256:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bb4cfe000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788587144.798270:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788587144.798275:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875469127571840:0@lo:8:kworker.0 00000100:00100000:3.0:1788587144.798307:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127572096:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.798346:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.798374:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572096 00000100:00100000:3.0:1788587144.798379:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572096 00000100:00100000:3.0:1788587144.798408:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587144.798431:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127572096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.798619:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127572096:12345-0@lo:400:kworker.0 Request processed in 203us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.798627:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587144.800729:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127572096:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.800744:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127571456:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.800805:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.800851:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127571456 00000100:00100000:3.0:1788587144.800858:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127571456 00000100:00100000:3.0:1788587144.800902:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788587144.800910:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b9a702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3646:x1875469127571456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.800956:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b9a702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3646:x1875469127571456:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.800963:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788587144.801007:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127571456:0@lo:400:kworker.0 00000100:00080000:0.0:1788587144.801179:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587144.801184:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587144.801187:0:37:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587144.801195:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f5bbfa54800 using connection 192.168.203.101@tcp/0@lo 00000100:00100000:0.0:1788587144.801215:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f5a84466a00 x1875469127572352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587144.801587:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127572352:0@lo:8:kworker.0 00000100:00100000:3.0:1788587144.801630:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.801783:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572352 00000100:00100000:3.0:1788587144.801787:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572352 00000100:00100000:3.0:1788587144.801811:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587144.801817:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875469127572352:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587144.801844:0:18698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1788587144.801871:0:18698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xfbc93bbea5fdace5 00002000:00100000:3.0:1788587144.801884:0:18698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f5a832a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788587144.801888:0:18698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788587144.801890:0:18698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587144.801955:0:18698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788587144.801976:0:18698:0:(import.c:65:import_set_state_nolock()) ffff8f5a832a2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587144.802016:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875469127572352:12345-0@lo:8:kworker.0 Request processed in 198us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.802023:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788587144.802056:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84466a00 x1875469127572352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587144.802068:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788587144.802074:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788587144.802079:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788587144.802081:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa54800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788587144.802095:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788587144.802100:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875469127572352:0@lo:8:kworker.0 00000004:00080000:3.0:1788587144.802121:0:17934:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788587144.802184:0:17934:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 490732767384ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788587144.802190:0:17934:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788587144.802342:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127572736:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.802373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.802408:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572736 00000100:00100000:3.0:1788587144.802412:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572736 00000100:00100000:3.0:1788587144.804831:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587144.804849:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127572736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.804935:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127572736:12345-0@lo:400:kworker.0 Request processed in 94us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.804942:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788587144.804970:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788587144.805999:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465180 x1875469127572736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.806014:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127572736:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.806039:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587144.806049:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127572224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.806095:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.806133:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572224 00000100:00100000:3.0:1788587144.806139:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572224 00000100:00100000:3.0:1788587144.806177:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587144.806184:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127572224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.806222:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127572224:12345-0@lo:400:kworker.0 Request processed in 39us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.806228:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587144.806255:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465f80 x1875469127572224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.806264:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127572224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.806271:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127572864:0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.806300:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.806339:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572864 00000100:00100000:3.0:1788587144.806343:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572864 00000100:00100000:3.0:1788587144.806374:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587144.806381:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127572864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587144.806431:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875469127572864:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.806438:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788587144.806463:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587144.806483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84466d80 x1875469127572864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587144.806491:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875469127572864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810058:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127572608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.810186:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788587144.810193:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127572480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810216:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.810235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127572992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810260:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788587144.810292:0:17217:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587144.810382:0:17217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 490740965333ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788587144.810388:0:17217:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788587144.810470:0:17935:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788587144.810508:0:17935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17935:1875469127573248:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788587144.810536:0:17935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.810554:0:17935:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82dd2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587144.810578:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572608 00000100:00100000:1.0:1788587144.810584:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572608 00000100:00100000:1.0:1788587144.810627:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572480 00000100:00100000:1.0:1788587144.810630:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572480 00000100:00100000:1.0:1788587144.810642:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127572992 00000100:00100000:1.0:1788587144.810645:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127572992 00000100:00100000:1.0:1788587144.810660:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587144.810669:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127572608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810715:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875469127572608:12345-0@lo:400:kworker.0 Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.810721:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587144.810737:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587144.810742:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127572480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810768:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127572480:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.810773:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587144.810784:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788587144.810790:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127572992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.810813:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127572992:12345-0@lo:400:kworker.0 Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.810819:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788587144.810971:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127573120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587144.810999:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788587144.811041:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84466300 x1875469127572480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.811056:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127572480:0@lo:400:kworker.0 00010000:00080000:1.0:1788587144.811067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84464a80 x1875469127572992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.811075:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127572992:0@lo:400:kworker.0 00010000:00080000:1.0:1788587144.811085:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465500 x1875469127572608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.811093:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875469127572608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587144.811123:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573248 00000100:00100000:1.0:1788587144.811127:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573248 00000100:00100000:1.0:1788587144.811155:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587144.811162:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17935:x1875469127573248:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1788587144.811353:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587144.811359:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587144.811361:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587144.811383:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573120 00000100:00100000:1.0:1788587144.811389:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573120 00000100:00100000:1.0:1788587144.811454:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587144.811462:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875469127573120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587144.811482:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788587144.811530:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875469127573120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587144.811538:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788587144.811571:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb4e34380 x1875469127573120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.811593:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127573120:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788587144.811647:0:17216:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788587144.811663:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1875469127573504:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788587144.811688:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.811709:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573504 00000100:00100000:1.0:1788587144.811712:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573504 00000100:00100000:1.0:1788587144.811741:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587144.811747:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17216:x1875469127573504:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788587144.811862:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587144.811873:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b82dd2780 going to sleep for 11 seconds 00000004:00080000:0.0:1788587144.811995:0:17215:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788587144.812071:0:17215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 490742654075ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788587144.812076:0:17215:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788587144.812106:0:17218:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788587144.813729:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127573376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587144.813799:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.813840:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587144.813846:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127573632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587144.813870:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587144.813904:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573376 00000100:00100000:2.0:1788587144.813911:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573376 00000100:00100000:2.0:1788587144.813942:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573632 00000100:00100000:2.0:1788587144.813945:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573632 00000100:00100000:2.0:1788587144.813969:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587144.813978:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875469127573376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587144.813997:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788587144.814038:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875469127573376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587144.814044:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587144.814059:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587144.814066:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127573632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587144.814075:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788587144.814100:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875469127573632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587144.814106:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788587144.814120:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788587144.814160:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84465500 x1875469127573632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587144.814178:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127573632:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788587144.814188:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84520a80 x1875469127573376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587144.814199:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127573376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587144.814694:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1875469127573760:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788587144.814730:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587144.814754:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba05546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587144.814877:0:18697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788587144.814886:0:18697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788587144.815786:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573760 00000100:00100000:0.0:1788587144.815793:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573760 00000100:00100000:2.0:1788587144.815984:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587144.815993:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17218:x1875469127573760:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788587144.836340:0:18698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788587144.836353:0:18698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788587144.836479:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17935:x1875469127573248:12345-0@lo:7:osp-pre-1-1.0 Request processed in 25312us (25936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587144.836490:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:2.0:1788587144.837363:0:19770:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788587144.837373:0:19770:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788587144.837378:0:19770:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00010000:00080000:1.0:1788587144.838790:0:17935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84521500 x1875469127573248/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788587160 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.838810:0:17935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17935:1875469127573248:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788587144.838825:0:17935:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788587144.838874:0:17935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17935:1875469127573888:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788587144.838954:0:17935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.838986:0:17935:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbca7f000 going to sleep for 11 seconds 00002000:00080000:1.0:1788587144.839007:0:19394:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788587144.839013:0:19394:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788587144.839018:0:19394:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:3.0:1788587144.840664:0:17923:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788587144.841506:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127573888 00000100:00100000:3.0:1788587144.841517:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127573888 00000100:00100000:3.0:1788587144.841588:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587144.841598:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17935:x1875469127573888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788587144.841630:0:18697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788587144.841708:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17935:x1875469127573888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 112us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.841714:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:2.0:1788587144.867500:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.867514:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.867531:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.867536:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.867542:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.867589:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.867600:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.867608:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.867628:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.869060:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.869074:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.869088:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.869093:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.869124:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.869148:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.869157:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdacec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.869181:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.869183:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.869185:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587144.871130:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.871142:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.871159:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.871164:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.871171:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.871184:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.871194:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.871221:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.871293:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788587144.873471:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.873484:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.873500:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.873505:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.873511:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.873523:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.873532:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.873540:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874708:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587144.874719:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874731:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1bc00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.874737:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874748:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874766:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874774:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3a5973/0xfbc93bbea5fdacf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874806:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.874810:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874816:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.874819:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874826:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874836:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.874844:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.874845:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.874847:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.876112:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.876121:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876146:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.876151:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.876157:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876173:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876184:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876192:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876211:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587144.876604:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.876611:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876619:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.876622:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.876626:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876635:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876655:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876662:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.876681:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587144.877057:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587144.877066:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877075:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.877079:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877100:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877118:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877125:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000992fb6d6/0xfbc93bbea5fdad01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877145:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.877148:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877155:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.877158:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877166:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877176:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877183:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4109a25/0xfbc93bbea5fdad08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.877209:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.877211:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.877212:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.877288:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.877294:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.877302:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.877305:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.877309:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.877318:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.877326:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.877332:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.877643:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788587144.877830:0:17935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84521500 x1875469127573888/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788587160 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587144.877846:0:17935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17935:1875469127573888:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788587144.877860:0:17935:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788587144.877908:0:17935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17935:1875469127574016:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788587144.878162:0:17935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.878193:0:17935:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b84e63c00 going to sleep for 11 seconds 00002000:00010000:1.0:1788587144.881939:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.881953:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.881959:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.881968:0:19770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6715837/0xfbc93bbea5fdacfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882028:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.882032:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.882038:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882052:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882062:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882068:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882084:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788587144.882717:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.882725:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882735:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.882739:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.882743:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882753:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882762:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882770:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.882781:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788587144.883107:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.883114:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883122:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.883131:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.883136:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883146:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883154:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883161:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883169:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788587144.883754:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.883763:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883773:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.883776:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.883781:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883792:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883800:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883813:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.883822:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788587144.884520:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.884528:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.884537:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.884540:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.884544:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.884619:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.884628:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.884636:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.884647:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788587144.885064:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.885070:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885085:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.885088:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.885092:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885101:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885109:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885117:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885125:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788587144.885375:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788587144.885383:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885391:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.885395:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885404:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885432:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885451:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eba3ea1/0xfbc93bbea5fdad0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885481:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788587144.885485:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885492:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.885502:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885510:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587144.885517:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.885520:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.885523:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885528:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b536533/0xfbc93bbea5fdad16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.885531:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.885534:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.885538:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.885540:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788587144.885544:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.885547:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.885555:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.885563:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.885571:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788587144.885663:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.885668:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885676:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.885679:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.885683:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885692:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885712:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885718:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.885726:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788587144.885992:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.885998:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.886006:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.886009:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.886019:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.886029:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886032:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886035:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.886037:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.886045:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886045:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.886054:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788587144.886056:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886062:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ad8355/0xfbc93bbea5fdad1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886084:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788587144.886088:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886094:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886097:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886105:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886116:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886123:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001cf57dd/0xfbc93bbea5fdad24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886136:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788587144.886140:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886146:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886149:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886167:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886177:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886185:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051c2c8be/0xfbc93bbea5fdad2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886197:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788587144.886201:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886206:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886209:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886217:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886226:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886233:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a2124b/0xfbc93bbea5fdad32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886255:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587144.886259:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886265:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80030e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886268:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886277:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886287:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886294:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce9d9fc/0xfbc93bbea5fdad39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886305:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587144.886309:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886315:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1b400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886317:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886334:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886344:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886350:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a1f6db/0xfbc93bbea5fdad40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886362:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587144.886365:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886371:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.886373:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886380:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886387:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.886394:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000288b2237/0xfbc93bbea5fdad47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587144.886648:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.886654:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.886662:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.886665:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.886669:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.886678:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.886686:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.886693:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.886714:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788587144.887077:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.887094:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.887103:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.887112:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.887117:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.887127:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.887135:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.887152:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.887160:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788587144.887667:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.887674:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.887683:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.887686:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.887690:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.887700:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.887708:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.887715:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.887723:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000004:00080000:1.0:1788587144.887838:0:17171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788587144.888060:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587144.888067:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888075:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a83c1a600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.888079:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888088:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888103:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888111:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939338ca/0xfbc93bbea5fdad4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888126:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587144.888129:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888135:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b80031e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.888139:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888158:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888169:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888176:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011ceedf2/0xfbc93bbea5fdad55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888188:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587144.888192:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888198:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.888201:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888208:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888217:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888224:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073051221/0xfbc93bbea5fdad5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888246:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.888250:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888256:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224de00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.888259:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888267:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888277:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888284:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5be5165/0xfbc93bbea5fdad63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.888295:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.888298:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.888300:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587144.888319:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574016 00000100:00100000:2.0:1788587144.888329:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574016 00000100:00100000:2.0:1788587144.888380:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587144.888389:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17935:x1875469127574016:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788587144.888455:0:18698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:2.0:1788587144.888542:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.888545:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.888553:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.889407:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.890189:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.890200:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890216:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.890221:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.890227:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890241:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890251:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890258:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890273:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.890525:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.890532:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890541:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.890545:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890562:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890579:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890586:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdad6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.890603:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.890605:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.890607:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.892225:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.892237:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892252:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.892256:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.892261:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892274:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892284:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892299:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892314:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.892500:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.892507:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892516:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.892520:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892531:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892546:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892553:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdad71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892569:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.892570:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.892572:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.892619:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.892631:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892639:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.892643:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.892647:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892656:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892664:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892671:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892685:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.892693:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.892698:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892705:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.892708:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892715:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892732:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892739:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fc51524/0xfbc93bbea5fdad78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.892752:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.892755:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.892756:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788587144.894457:0:17171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788587144.895024:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.895034:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895051:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.895055:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.895062:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895077:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895086:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895095:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895125:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.895314:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.895320:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895328:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.895333:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895343:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895358:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895366:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bd1c436/0xfbc93bbea5fdad7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895383:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.895385:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.895387:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.895459:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.895464:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895472:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.895481:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.895486:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895496:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895504:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895511:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895524:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.895532:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.895537:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895544:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.895547:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895560:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895570:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895588:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab446187/0xfbc93bbea5fdad86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.895601:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.895603:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.895605:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.896786:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.896796:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.896810:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.896814:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.896819:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.896832:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.896840:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.896847:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.896863:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.897015:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.897026:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897034:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.897038:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897047:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897060:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897080:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c141b097/0xfbc93bbea5fdad8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897097:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.897098:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.897100:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.897139:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.897145:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897153:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.897156:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.897160:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897179:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897188:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897195:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897210:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587144.897217:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587144.897221:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897227:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587144.897230:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897237:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897247:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897254:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec851e47/0xfbc93bbea5fdad94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897272:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.897274:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.897275:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.897906:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.897914:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897922:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.897925:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.897929:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897939:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897947:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897954:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.897979:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587144.898244:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.898250:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898268:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.898272:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.898277:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898286:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898294:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898301:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898315:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788587144.898674:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.898680:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898689:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.898691:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.898696:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898704:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898723:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898730:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.898744:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788587144.898995:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.899001:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.899009:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.899012:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.899016:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.899025:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.899032:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.899039:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.899067:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788587144.900143:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.900151:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.900163:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.900166:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.900171:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.900183:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.900192:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.900199:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.900208:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788587144.900524:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788587144.900532:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900541:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.900546:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900565:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900584:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900592:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085cbb5d/0xfbc93bbea5fdad9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900614:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788587144.900619:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900637:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.900640:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900648:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900659:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900666:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fc1bdc4/0xfbc93bbea5fdada2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900680:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788587144.900684:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900690:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.900693:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900699:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900708:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900721:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdada9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900734:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587144.900737:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900743:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.900747:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900754:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900764:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900770:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043909127/0xfbc93bbea5fdadb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900781:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.900784:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900790:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.900798:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900805:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900814:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900820:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97e355a/0xfbc93bbea5fdadb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.900832:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.900833:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.900835:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.900912:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.902609:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.902621:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.902637:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.902649:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.902656:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.902669:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.902680:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.902688:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.902709:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.903152:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.903160:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.903169:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.903174:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.903183:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.903199:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.903214:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ec1ed2f/0xfbc93bbea5fdadbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.903237:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.903239:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.903240:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.903324:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.903330:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.903339:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.903342:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.903346:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.903356:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.903364:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.903377:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.903583:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.904896:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.904906:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.904918:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.904922:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.904934:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.904951:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.904960:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e16cef5/0xfbc93bbea5fdadc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.904982:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.904984:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.904985:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587144.905221:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587144.905409:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788587144.905431:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587144.905574:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.905580:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.905590:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.905594:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.905600:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.905611:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.905620:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.905627:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.905875:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1788587144.905879:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587144.905883:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.905893:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.905901:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.905908:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.905930:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788587144.906316:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.906323:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.906332:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.906335:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.906339:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906598:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587144.906605:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587144.906619:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587144.906623:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.906627:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906636:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906650:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906658:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073051221/0xfbc93bbea5fdadd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906677:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.906680:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906686:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.906689:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906696:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906708:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906720:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fe494ef/0xfbc93bbea5fdadcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.906735:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.906737:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.906739:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.906942:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.906950:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.906957:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907116:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.907208:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.907214:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907222:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.907225:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907233:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907244:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907252:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e59705/0xfbc93bbea5fdadda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907270:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.907272:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.907274:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.907315:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587144.907897:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.907904:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907914:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.907918:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.907923:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907934:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907942:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.907950:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.908530:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.908542:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.908557:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.908576:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.908580:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.908590:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.908604:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.908612:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdade1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.908629:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.908630:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.908632:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587144.909137:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788587144.909144:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.909155:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788587144.909159:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587144.909164:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.909175:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.909189:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.909197:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.909216:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587144.909753:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.909760:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.909769:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.909772:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.909781:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.909801:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.909809:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007d66d6f/0xfbc93bbea5fdade8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.909824:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.909826:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.909828:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587144.910332:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788587144.910340:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910351:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788587144.910354:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587144.910359:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910371:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910380:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910388:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910434:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587144.910453:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587144.910458:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910465:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587144.910469:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910476:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910488:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910496:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5fec75e/0xfbc93bbea5fdadef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910509:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.910511:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.910512:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587144.910922:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788587144.910929:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910938:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788587144.910946:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587144.910951:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910961:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910981:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.910989:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.911005:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587144.911685:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788587144.911693:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.911703:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788587144.911707:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587144.911711:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.912187:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.912198:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.912309:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.912336:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587144.912713:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587144.912722:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912732:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f4a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.912737:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912746:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912763:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912770:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000275e0f58/0xfbc93bbea5fdadf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912788:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.912791:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912804:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.912807:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912815:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912825:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912831:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffed47d0/0xfbc93bbea5fdadfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.912843:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.912844:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.912846:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.913213:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.913220:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913229:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.913233:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.913238:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913249:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913264:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913271:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913285:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587144.913499:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587144.913505:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.913513:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224da00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587144.913516:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.913524:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.913536:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.913543:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9318ee7/0xfbc93bbea5fdae04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.913562:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.913564:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.913566:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.913795:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.913801:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913810:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.913812:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.913816:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913824:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913832:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913839:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.913867:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587144.914158:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.914164:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914172:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.914175:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.914179:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914187:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914195:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914202:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914213:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788587144.914355:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587144.914367:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914374:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224d000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587144.914378:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914386:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914397:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914404:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec666fe4/0xfbc93bbea5fdae0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914449:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587144.914453:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914459:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224ce00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587144.914462:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914469:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914490:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914498:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005471d406/0xfbc93bbea5fdae12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.914511:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.914513:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.914514:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.914520:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.914887:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.914894:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914902:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.914911:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.914916:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914926:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914934:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914941:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.914959:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788587144.915106:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.915113:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915121:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.915124:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.915128:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915138:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915146:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915153:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915184:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788587144.915285:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587144.915291:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915298:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224d200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.915301:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915310:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915322:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915330:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdae19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915343:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587144.915347:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915353:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587144.915355:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915372:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915382:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915390:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc51524/0xfbc93bbea5fdae20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.915402:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.915404:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.915405:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.915826:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587144.916448:0:19394:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.916457:0:19394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.916468:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.916471:0:19394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.916476:0:19394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.916487:0:19394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.916495:0:19394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.916514:0:19394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.916531:0:19394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788587144.916589:0:19394:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788587144.916686:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17216:x1875469127573504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 104935us (104993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.916695:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587144.916751:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84523480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1875469127573504:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788587144.916766:0:17216:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788587144.916823:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1875469127574144:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788587144.916854:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587144.916887:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574144 00000100:00100000:3.0:1788587144.916893:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574144 00000100:00100000:3.0:1788587144.916926:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587144.916935:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17216:x1875469127574144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788587144.916978:0:18699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:3.0:1788587144.917084:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bbbe1a300 going to sleep for 11 seconds 00010000:00010000:1.0:1788587144.917227:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.917234:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917243:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.917247:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917256:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917271:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917286:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5dcdf75/0xfbc93bbea5fdae27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917305:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.917307:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.917309:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.917569:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.917575:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917585:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.917588:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.917593:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917605:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917614:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917621:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917636:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587144.917644:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.917653:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917660:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224d400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.917663:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917671:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917681:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917689:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009595298e/0xfbc93bbea5fdae2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.917703:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.917705:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.917706:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.918092:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.918097:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918106:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.918110:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.918114:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918134:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918143:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918151:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918164:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587144.918172:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.918176:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918183:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224dc00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.918186:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918194:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918205:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918213:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b8ceeb/0xfbc93bbea5fdae35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918232:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.918233:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.918235:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.918892:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.918899:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918908:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.918912:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.918916:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918926:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918935:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918941:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918956:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587144.918976:0:17179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.918981:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.918999:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c000 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.919002:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.919012:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.919024:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.919031:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092f48a6f/0xfbc93bbea5fdae3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.919046:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.919048:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.919050:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.921242:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.921253:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921268:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.921273:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.921279:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921293:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921311:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921320:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921338:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587144.921349:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.921355:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921363:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224d600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.921367:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921376:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921392:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921400:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000203a29c1/0xfbc93bbea5fdae43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921434:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.921452:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.921455:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587144.921914:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.921920:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921929:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.921932:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.921937:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921946:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921954:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.921961:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587144.922559:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.923904:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587144.925210:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788587144.925221:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925238:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1788587144.925242:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587144.925249:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925272:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925283:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925290:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925307:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587144.925317:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587144.925323:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925331:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224ca00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.925336:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925345:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925362:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925371:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eb3cc1/0xfbc93bbea5fdae4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925397:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.925401:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925408:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c800 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.925411:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925450:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925462:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925469:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081e2108d/0xfbc93bbea5fdae51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.925481:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.925483:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.925484:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587144.925717:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587144.927236:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.927245:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.927260:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.927270:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.927276:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.927289:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.927299:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.927307:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.927323:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788587144.927826:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.927833:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.928212:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.928216:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.928220:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.928232:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.928240:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.928255:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.928308:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788587144.929023:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788587144.929031:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.929041:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788587144.929045:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587144.929049:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.929060:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.929069:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587144.929077:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929150:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788587144.929158:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929166:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.929177:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929186:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929202:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929209:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bd1c436/0xfbc93bbea5fdae58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929228:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587144.929232:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929238:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71600 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.929242:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929249:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929259:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929267:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056e59705/0xfbc93bbea5fdae5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929286:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587144.929289:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929295:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa71a00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587144.929299:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929306:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929317:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587144.929325:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.929327:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587144.929328:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587144.929499:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788587144.930160:0:18693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788587144.930199:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788587144.930341:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17216:x1875469127574144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13404us (13483us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788587144.930351:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587144.930405:0:17216:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788587144.930413:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17216:1875469127574144:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788587144.930456:0:17216:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788587144.933579:0:19770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788587144.933592:0:19770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b32ee4/0xfbc93bbea5fdae66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788587144.933725:0:19770:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788587144.933826:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17218:x1875469127573760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 117831us (119091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587144.933837:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788587144.933943:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788587144.934336:0:19513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788587144.934370:0:19513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788587144.934374:0:19513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788587144.934960:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1875469127573760:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788587144.935096:0:17218:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788587144.935143:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1875469127574272:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788587144.935190:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587144.935222:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba05546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587144.935288:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574272 00000100:00100000:3.0:1788587144.935295:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574272 00000100:00100000:3.0:1788587144.935347:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587144.935356:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17218:x1875469127574272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788587144.935391:0:19394:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1788587144.940782:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17935:x1875469127574016:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52385us (62808us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788587144.940795:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587144.940848:0:17935:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788587144.940857:0:17935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17935:1875469127574016:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788587144.940872:0:17935:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788587144.940924:0:17935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17935:1875469127574400:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788587144.940958:0:17935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587144.941815:0:17935:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bb4e6fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587144.941890:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574400 00000100:00100000:0.0:1788587144.941897:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574400 00000100:00100000:3.0:1788587144.942096:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17218:x1875469127574272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6739us (6904us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788587144.942105:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587144.942206:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587144.942216:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17935:x1875469127574400:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788587144.942266:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17935:x1875469127574400:12345-0@lo:900:osp-pre-1-1.0 Request processed in 52us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587144.942279:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788587144.942367:0:17935:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a84521500 x1875469127574400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587160 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587144.942380:0:17935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84521500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17935:1875469127574400:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788587144.942922:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17218:1875469127574272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788587144.942933:0:17218:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:2.0:1788587145.045729:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587145.621647:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587146.462519:0:19869:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788587146.652087:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788587147.364885:0:19921:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788587147.365329:0:19921:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788587147.670954:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788587148.124335:0:19971:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788587148.125198:0:19971:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788587148.333038:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.333154:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723584 00000100:00100000:0.0:1788587148.333164:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723584 00000100:00100000:0.0:1788587148.333200:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 114 00000100:00100000:0.0:1788587148.333209:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2405:x1875469110723584:12345-192.168.203.1@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788587148.333232:0:17185:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 38609982-39d4-4f97-a9ad-eea20d935b3f@192.168.203.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1788587148.333258:0:17185:0:(genops.c:1385:class_connect()) connect: client 38609982-39d4-4f97-a9ad-eea20d935b3f, cookie 0xfbc93bbea5fdae6d 00000100:00080000:0.0:1788587148.333380:0:17185:0:(import.c:65:import_set_state_nolock()) ffff8f5a822f2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587148.333481:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+5:2405:x1875469110723584:12345-192.168.203.1@tcp:250:mount.lustre.0 Request processed in 271us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587148.333489:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 114 00000100:00100000:1.0:1788587148.340589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.340668:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723712 00000100:00100000:0.0:1788587148.340679:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723712 00000100:00100000:0.0:1788587148.340734:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 115 00000100:00100000:0.0:1788587148.340744:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+5:14896:x1875469110723712:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587148.340760:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587148.340776:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdae74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810b9a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587148.340817:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdae74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b9a expref: 6 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587148.340829:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f5a00/0xfbc93bbea5fdae74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810b9a expref: 6 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587148.340839:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f5a00, rc 0) 00000100:00100000:0.0:1788587148.340891:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+6:14896:x1875469110723712:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587148.340898:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 115 00000100:00100000:0.0:1788587148.344004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.347136:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723840 00000100:00100000:2.0:1788587148.347151:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723840 00000100:00100000:2.0:1788587148.347211:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 116 00000100:00100000:2.0:1788587148.347221:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+6:14896:x1875469110723840:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587148.347349:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+6:14896:x1875469110723840:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 128us (3374us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587148.347357:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 116 00000100:00100000:3.0:1788587148.349799:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.350783:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110723968 00000100:00100000:2.0:1788587148.350801:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110723968 00000100:00100000:2.0:1788587148.350859:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00100000:2.0:1788587148.350869:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba19f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+6:14896:x1875469110723968:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587148.350895:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587148.350914:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bc2051e00/0xfbc93bbea5fdae7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ba1 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.350942:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2051e00/0xfbc93bbea5fdae7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ba1 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.350953:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bc2051e00/0xfbc93bbea5fdae7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ba1 expref: 7 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.350962:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051e00, rc 0) 00000100:00100000:2.0:1788587148.351018:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba19f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+7:14896:x1875469110723968:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 150us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.351025:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 117 00000100:00100000:1.0:1788587148.356379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.356502:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724096 00000100:00100000:0.0:1788587148.356523:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724096 00000100:00100000:0.0:1788587148.356575:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 118 00000100:00100000:0.0:1788587148.356585:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba07b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+7:14896:x1875469110724096:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587148.357052:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba07b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14896:x1875469110724096:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 467us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587148.357061:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 118 00000100:00100000:0.0:1788587148.358977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.362516:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724224 00000100:00100000:2.0:1788587148.362696:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724224 00000100:00100000:2.0:1788587148.362772:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 119 00000100:00100000:2.0:1788587148.362781:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14896:x1875469110724224:12345-192.168.203.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587148.363745:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14896:x1875469110724224:12345-192.168.203.1@tcp:503:mount.lustre.0 Request processed in 961us (4773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.363754:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 119 00000100:00100000:3.0:1788587148.369764:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.370067:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724352 00000100:00100000:0.0:1788587148.370077:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724352 00000100:00100000:0.0:1788587148.370168:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 120 00000100:00100000:0.0:1788587148.370179:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14914:x1875469110724352:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587148.370335:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14914:x1875469110724352:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 157us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587148.370353:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 120 00000100:00100000:1.0:1788587148.391520:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.391926:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724480 00000100:00100000:2.0:1788587148.391936:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724480 00000100:00100000:2.0:1788587148.391992:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 121 00000100:00100000:2.0:1788587148.392001:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14914:x1875469110724480:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587148.392669:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14914:x1875469110724480:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 666us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587148.392679:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 121 00000100:00100000:0.0:1788587148.405040:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.405357:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724608 00000100:00100000:2.0:1788587148.405366:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724608 00000100:00100000:2.0:1788587148.405470:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 122 00000100:00100000:2.0:1788587148.405481:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14914:x1875469110724608:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587148.405638:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14914:x1875469110724608:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 158us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.405647:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 122 00000100:00100000:1.0:1788587148.419366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587148.425605:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724736 00000100:00100000:3.0:1788587148.425621:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724736 00000100:00100000:2.0:1788587148.427058:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 123 00000100:00100000:2.0:1788587148.427072:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+8:14896:x1875469110724736:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587148.427090:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587148.427108:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fdae82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810bd2 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.427138:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fdae82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd2 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.427149:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bc2051a00/0xfbc93bbea5fdae82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd2 expref: 9 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.427174:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051a00, rc 0) 00000100:00100000:2.0:1788587148.427246:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+9:14896:x1875469110724736:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 177us (7887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.427253:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 123 00000100:00100000:1.0:1788587148.430215:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587148.430467:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724864 00000100:00100000:3.0:1788587148.430477:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724864 00000100:00100000:3.0:1788587148.430642:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 124 00000100:00100000:3.0:1788587148.430652:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+9:14896:x1875469110724864:12345-192.168.203.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788587148.430692:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788587148.430707:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587148.430712:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788587148.430715:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788587148.430718:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788587148.430721:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788587148.439190:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+9:14896:x1875469110724864:12345-192.168.203.1@tcp:256:mount.lustre.0 Request processed in 8522us (8966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587148.439205:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 124 00000100:00100000:0.0:1788587148.447072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.447402:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110724992 00000100:00100000:2.0:1788587148.447411:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110724992 00000100:00100000:2.0:1788587148.448182:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 125 00000100:00100000:2.0:1788587148.448197:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+9:14896:x1875469110724992:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587148.448215:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587148.448234:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810bd9 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.448273:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.448285:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 10 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587148.448294:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050c00, rc 0) 00000100:00100000:2.0:1788587148.448356:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14896:x1875469110724992:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 165us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.448364:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 125 00000100:00100000:1.0:1788587148.452306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587148.452458:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725120 00000100:00100000:3.0:1788587148.452468:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725120 00000100:00100000:3.0:1788587148.452537:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 126 00000100:00100000:3.0:1788587148.452546:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14896:x1875469110725120:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788587148.452691:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14896:x1875469110725120:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 146us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587148.452698:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 126 00000100:00100000:1.0:1788587148.455136:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.455281:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725248 00000100:00100000:2.0:1788587148.455290:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725248 00000100:00100000:2.0:1788587148.455340:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:2.0:1788587148.455350:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bad5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14896:x1875469110725248:12345-192.168.203.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587148.455550:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bad5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14896:x1875469110725248:12345-192.168.203.1@tcp:503:mount.lustre.0 Request processed in 201us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.455558:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:0.0:1788587148.458756:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.458987:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725376 00000100:00100000:2.0:1788587148.458998:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725376 00000100:00100000:2.0:1788587148.459053:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:2.0:1788587148.459063:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14919:x1875469110725376:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587148.459792:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14919:x1875469110725376:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 727us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.459802:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:1.0:1788587148.465050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587148.466962:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725504 00000100:00100000:3.0:1788587148.466976:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725504 00000100:00100000:3.0:1788587148.467094:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 129 00000100:00100000:3.0:1788587148.467116:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14919:x1875469110725504:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587148.467283:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+10:14919:x1875469110725504:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 179us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587148.467291:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 129 00000100:00100000:1.0:1788587148.479768:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.480068:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725632 00000100:00100000:2.0:1788587148.480077:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725632 00000100:00100000:2.0:1788587148.480120:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:2.0:1788587148.480129:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1875469110725632:12345-192.168.203.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587148.480154:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cea8b0dc-76f5-470d-a41c-45365485d47c@192.168.203.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1788587148.480201:0:17191:0:(genops.c:1385:class_connect()) connect: client cea8b0dc-76f5-470d-a41c-45365485d47c, cookie 0xfbc93bbea5fdae90 00000004:00100000:2.0:1788587148.480224:0:17191:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587148.480456:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8f5a83009800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587148.480658:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2405:x1875469110725632:12345-192.168.203.1@tcp:38:mount.lustre.0 Request processed in 527us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.480666:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:1.0:1788587148.480751:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.480830:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725888 00000100:00100000:2.0:1788587148.480835:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725888 00000100:00100000:2.0:1788587148.480861:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:2.0:1788587148.480866:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1875469110725888:12345-192.168.203.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587148.480907:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from cea8b0dc-76f5-470d-a41c-45365485d47c@192.168.203.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1788587148.480938:0:17193:0:(genops.c:1385:class_connect()) connect: client cea8b0dc-76f5-470d-a41c-45365485d47c, cookie 0xfbc93bbea5fdae97 00000004:00100000:2.0:1788587148.480953:0:17193:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587148.481096:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8f5a8300c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587148.481124:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2405:x1875469110725888:12345-192.168.203.1@tcp:38:mount.lustre.0 Request processed in 256us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.481131:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:0.0:1788587148.503281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.503320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.503398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587148.503514:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726144 00000100:00100000:1.0:1788587148.503524:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726144 00000100:00100000:3.0:1788587148.503626:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110725760 00000100:00100000:1.0:1788587148.503627:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726016 00000100:00100000:3.0:1788587148.503631:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110725760 00000100:00100000:1.0:1788587148.503633:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726016 00000100:00100000:3.0:1788587148.503661:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00080000:0.0:1788587148.503674:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587148.503678:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587148.503685:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:14896:x1875469110726144:12345-192.168.203.1@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788587148.503704:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:0.0:1788587148.503714:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+7:0:x1875469110725760:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587148.503723:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000004:00000024:0.0:1788587148.503731:0:19333:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788587148.503824:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+7:0:x1875469110725760:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 111us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587148.503831:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:1.0:1788587148.504391:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:1.0:1788587148.504399:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+6:0:x1875469110726016:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587148.504452:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788587148.507806:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726144:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 4113us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587148.507820:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:1.0:1788587148.509145:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+6:0:x1875469110726016:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 4585us (5583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587148.509157:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:0.0:1788587148.516681:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587148.516930:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726272 00000100:00100000:2.0:1788587148.516939:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726272 00000100:00100000:2.0:1788587148.517007:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00100000:2.0:1788587148.517017:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726272:12345-192.168.203.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788587148.517111:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726272:12345-192.168.203.1@tcp:40:mount.lustre.0 Request processed in 95us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.517118:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 12 00000100:00100000:0.0:1788587148.524628:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587148.524934:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726400 00000100:00100000:1.0:1788587148.524945:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726400 00000100:00100000:3.0:1788587148.525022:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788587148.525032:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2405:x1875469110726400:12345-192.168.203.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788587148.525065:0:19770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cea8b0dc-76f5-470d-a41c-45365485d47c@192.168.203.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1788587148.525097:0:19770:0:(genops.c:1385:class_connect()) connect: client cea8b0dc-76f5-470d-a41c-45365485d47c, cookie 0xfbc93bbea5fdae9e 00002000:00100000:3.0:1788587148.525109:0:19770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cea8b0dc-76f5-470d-a41c-45365485d47c/ffff8f5b86e76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587148.525126:0:19770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587148.525281:0:19770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587148.525308:0:19770:0:(import.c:65:import_set_state_nolock()) ffff8f5b86e75000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587148.525937:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2405:x1875469110726400:12345-192.168.203.1@tcp:8:mount.lustre.0 Request processed in 901us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.525946:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788587148.528585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587148.528736:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726656 00000100:00100000:1.0:1788587148.528745:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726656 00000100:00100000:1.0:1788587148.528853:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:1.0:1788587148.528864:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726656:12345-192.168.203.1@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788587148.528946:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726656:12345-192.168.203.1@tcp:900:mount.lustre.0 Request processed in 84us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587148.528954:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:2.0:1788587148.529846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587148.529915:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726528 00000100:00100000:3.0:1788587148.529921:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726528 00000100:00100000:3.0:1788587148.529956:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:3.0:1788587148.529962:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1875469110726528:12345-192.168.203.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788587148.529989:0:18697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cea8b0dc-76f5-470d-a41c-45365485d47c@192.168.203.1@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1788587148.530016:0:18697:0:(genops.c:1385:class_connect()) connect: client cea8b0dc-76f5-470d-a41c-45365485d47c, cookie 0xfbc93bbea5fdaea5 00002000:00100000:3.0:1788587148.530027:0:18697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cea8b0dc-76f5-470d-a41c-45365485d47c/ffff8f5baaa5f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587148.530043:0:18697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587148.530376:0:18697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587148.530407:0:18697:0:(import.c:65:import_set_state_nolock()) ffff8f5b8a0f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587148.530896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587148.530995:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726784 00000100:00100000:0.0:1788587148.531000:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726784 00000100:00100000:0.0:1788587148.531042:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:0.0:1788587148.531051:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726784:12345-192.168.203.1@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788587148.532501:0:17194:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1369us 00000100:00100000:2.0:1788587148.532806:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2405:x1875469110726528:12345-192.168.203.1@tcp:8:mount.lustre.0 Request processed in 2837us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.532819:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000004:00200000:3.0:1788587148.564354:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788587148.564795:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14896:x1875469110726784:12345-192.168.203.1@tcp:33:mount.lustre.0 Request processed in 33471us (33625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587148.564810:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:1.0:1788587148.629551:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127574528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587148.629630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587148.630337:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574528 00000100:00100000:2.0:1788587148.630347:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574528 00000100:00080000:0.0:1788587148.631454:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587148.631704:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587148.631722:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127574528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587148.631763:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788587148.631833:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127574528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587148.631841:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587148.631985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127574528:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788587148.692851:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587148.748148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587148.748323:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110726912 00000100:00100000:1.0:1788587148.748341:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110726912 00000100:00100000:1.0:1788587148.748444:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:1.0:1788587148.748457:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14942:x1875469110726912:12345-192.168.203.1@tcp:101:mkdir.0 00010000:00010000:1.0:1788587148.748476:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587148.748501:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdaeac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c0a expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587148.748600:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdaeb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587148.748613:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587148.748885:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587148.748937:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788587148.748941:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587148.748981:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdaeb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587148.749021:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdaeac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c0a expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587148.749047:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdaeb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c0a expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587148.749056:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:1.0:1788587148.749059:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587148.749062:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224c000, rc 0) 00000100:00100000:1.0:1788587148.749125:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:14942:x1875469110726912:12345-192.168.203.1@tcp:101:mkdir.0 Request processed in 671us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587148.749133:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:2.0:1788587149.141354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127574656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587149.141451:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587149.141601:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127574784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587149.141633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587149.141756:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574656 00000100:00100000:1.0:1788587149.141764:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574656 00000100:00100000:1.0:1788587149.141826:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574784 00000100:00100000:1.0:1788587149.141830:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574784 00000100:00100000:1.0:1788587149.141845:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587149.141854:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127574656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587149.141886:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788587149.142010:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587149.142019:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127574784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587149.142037:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788587149.142073:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127574784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587149.142079:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587149.142100:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127574784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587149.142806:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127574656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 950us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587149.142815:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587149.143136:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127574656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788587149.716664:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587150.164674:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127574912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587150.164750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587150.164895:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127574912 00000100:00100000:2.0:1788587150.164904:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127574912 00000100:00100000:2.0:1788587150.164972:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587150.164983:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127574912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587150.165022:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788587150.165067:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127574912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.165074:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788587150.165439:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587150.166802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127574912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587150.170039:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127575296:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.170117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.170151:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575296 00000100:00100000:2.0:1788587150.170158:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127575808:0@lo:400:kworker.0 00000100:00100000:0.0:1788587150.170159:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575296 00000100:00100000:2.0:1788587150.170206:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.170207:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788587150.170220:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:3646:x1875469127575296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.170228:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127576320:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.170283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.170289:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:3646:x1875469127575296:12345-0@lo:400:kworker.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.170298:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788587150.170327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127575296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.170343:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575808 00000100:00100000:2.0:1788587150.170345:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788587150.170351:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575808 00000100:00100000:0.0:1788587150.170353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587150.170356:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127575424:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.170393:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587150.170399:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.170435:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127575808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587150.170466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127575680:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.170492:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127575808:12345-0@lo:400:kworker.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.170500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.170505:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587150.170524:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127576192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.170543:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.170547:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576320 00000100:00100000:3.0:1788587150.170552:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576320 00000100:00100000:2.0:1788587150.170569:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127575936:0@lo:400:kworker.0 00000100:00100000:0.0:1788587150.170576:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587150.170604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587150.170624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127576448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.170639:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575424 00000100:00100000:1.0:1788587150.170644:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575424 00000100:00100000:2.0:1788587150.170649:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.170683:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127576704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.170900:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587150.170908:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127575424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.170946:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875469127575424:12345-0@lo:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.170952:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587150.170972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127575040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587150.170997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587150.171014:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127575552:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.171032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587150.171047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127576064:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.171062:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587150.171076:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127576576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.171102:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575936 00000100:00100000:1.0:1788587150.171105:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575936 00000100:00100000:1.0:1788587150.171133:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575552 00000100:00100000:1.0:1788587150.171135:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575552 00000100:00100000:1.0:1788587150.171161:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576064 00000100:00100000:1.0:1788587150.171164:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576064 00000100:00100000:1.0:1788587150.171176:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587150.171182:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127575936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.171216:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127575936:12345-0@lo:400:kworker.0 Request processed in 34us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.171222:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587150.171233:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587150.171237:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127575552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.171266:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127575552:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.171272:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587150.171282:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587150.171287:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127576064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.171311:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127576064:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.171316:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587150.174583:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127575808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.174616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875469127575424:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.174630:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127575936:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.174673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.177994:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575680 00000100:00100000:3.0:1788587150.178009:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575680 00000100:00100000:3.0:1788587150.178061:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576192 00000100:00100000:3.0:1788587150.178065:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576192 00000100:00100000:3.0:1788587150.178108:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576448 00000100:00100000:3.0:1788587150.178111:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576448 00000100:00100000:3.0:1788587150.178133:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587150.178261:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127576320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.178365:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875469127576320:12345-0@lo:400:kworker.0 Request processed in 108us (8083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.178372:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587150.178390:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587150.178395:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127575680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.178450:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875469127575680:12345-0@lo:400:kworker.0 Request processed in 55us (7953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.178456:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587150.178468:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788587150.178473:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127576192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.178497:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875469127576192:12345-0@lo:400:kworker.0 Request processed in 24us (7925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.178502:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788587150.178573:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587150.178580:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127576448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.178610:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875469127576448:12345-0@lo:400:kworker.0 Request processed in 31us (7962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.178626:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587150.179494:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575168 00000100:00100000:3.0:1788587150.179503:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575168 00000100:00100000:3.0:1788587150.180231:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127575040 00000100:00100000:3.0:1788587150.180237:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127575040 00000100:00100000:3.0:1788587150.180256:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587150.180274:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127575168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587150.180319:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788587150.180374:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587150.180381:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587150.180384:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587150.180386:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875469127575168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (9989us total) trans 0 rc 0/0 00000100:00080000:1.0:1788587150.180388:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587150.180397:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587150.180446:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587150.180455:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127575040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587150.180465:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00010000:00080000:1.0:1788587150.180487:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83665c00 x1875469127576448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587150.180503:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875469127576448:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.180510:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127575040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (9511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.180516:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587150.180524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875469127576320:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.180567:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127575040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587150.180582:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127575552:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.180592:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127576064:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.180617:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576704 00000100:00100000:2.0:1788587150.180622:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576704 00000100:00100000:1.0:1788587150.180643:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576576 00000100:00100000:1.0:1788587150.180655:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576576 00000100:00100000:2.0:1788587150.180665:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587150.180675:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127576704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.180686:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587150.180696:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127576576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.180731:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875469127576704:12345-0@lo:400:kworker.0 Request processed in 58us (6057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.180740:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788587150.180749:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127576576:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.180757:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788587150.180759:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587150.180764:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587150.180786:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127576576:0@lo:400:kworker.0 00010000:00080000:2.0:1788587150.180820:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83664380 x1875469127576704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587150.180830:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875469127576704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.180856:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587150.180872:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875469127575680:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.180885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875469127576192:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.181205:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587150.707736:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587150.707901:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727040 00000100:00100000:2.0:1788587150.707912:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727040 00000100:00100000:2.0:1788587150.707996:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:2.0:1788587150.708007:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:14994:x1875469110727040:12345-192.168.203.1@tcp:41:lfs.0 00000004:00000024:2.0:1788587150.708047:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788587150.708143:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a845edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:14994:x1875469110727040:12345-192.168.203.1@tcp:41:lfs.0 Request processed in 137us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.708150:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00080000:1.0:1788587150.708218:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587150.715553:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587150.716489:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727168 00000100:00100000:2.0:1788587150.716502:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727168 00000100:00100000:2.0:1788587150.716585:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:2.0:1788587150.716595:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14994:x1875469110727168:12345-192.168.203.1@tcp:41:lfs.0 00000004:00000024:2.0:1788587150.716646:0:17193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788587150.716749:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14994:x1875469110727168:12345-192.168.203.1@tcp:41:lfs.0 Request processed in 155us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587150.716757:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00080000:1.0:1788587150.716825:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587150.726339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587150.726497:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727296 00000100:00100000:1.0:1788587150.726508:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727296 00000100:00100000:1.0:1788587150.726587:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:1.0:1788587150.726597:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14994:x1875469110727296:12345-192.168.203.1@tcp:13:lfs.0 00002000:00000024:1.0:1788587150.726621:0:18701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788587150.726709:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14994:x1875469110727296:12345-192.168.203.1@tcp:13:lfs.0 Request processed in 113us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.726717:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00080000:2.0:1788587150.726791:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587150.731690:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587150.734289:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727424 00000100:00100000:0.0:1788587150.734304:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727424 00000100:00100000:0.0:1788587150.734394:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:0.0:1788587150.734443:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14994:x1875469110727424:12345-192.168.203.1@tcp:13:lfs.0 00002000:00000024:0.0:1788587150.734470:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788587150.734568:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cea8b0dc-76f5-470d-a41c-45365485d47c+6:14994:x1875469110727424:12345-192.168.203.1@tcp:13:lfs.0 Request processed in 165us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.734575:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00080000:2.0:1788587150.734752:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788587150.740635:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587150.933148:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587150.933225:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727552 00000100:00100000:3.0:1788587150.933235:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727552 00000100:00100000:3.0:1788587150.933288:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 131 00000100:00100000:3.0:1788587150.933308:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+10:15027:x1875469110727552:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587150.933325:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587150.933342:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaeba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c11 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587150.933385:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaeba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c11 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587150.933396:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa71a00/0xfbc93bbea5fdaeba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c11 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587150.933456:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71a00, rc 0) 00000100:00100000:3.0:1788587150.933788:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15027:x1875469110727552:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 488us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.933798:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 131 00000100:00100000:3.0:1788587150.936873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587150.937034:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727680 00000100:00100000:0.0:1788587150.937045:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727680 00000100:00100000:0.0:1788587150.937101:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 132 00000100:00100000:0.0:1788587150.937112:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15027:x1875469110727680:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587150.937339:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15027:x1875469110727680:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 228us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.937347:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 132 00000100:00100000:2.0:1788587150.940148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587150.940222:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727808 00000100:00100000:0.0:1788587150.940231:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727808 00000100:00100000:0.0:1788587150.940312:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 133 00000100:00100000:0.0:1788587150.940328:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15027:x1875469110727808:12345-192.168.203.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788587150.940525:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15027:x1875469110727808:12345-192.168.203.1@tcp:503:mount.lustre.0 Request processed in 197us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.940534:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 133 00000100:00100000:1.0:1788587150.977075:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587150.977299:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110727936 00000100:00100000:3.0:1788587150.977310:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110727936 00000100:00100000:3.0:1788587150.977365:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 134 00000100:00100000:3.0:1788587150.977376:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15033:x1875469110727936:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587150.977565:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15033:x1875469110727936:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 189us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.977573:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 134 00000100:00100000:3.0:1788587150.999830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587151.000141:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728064 00000100:00100000:0.0:1788587151.000152:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728064 00000100:00100000:0.0:1788587151.000210:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 135 00000100:00100000:0.0:1788587151.000221:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15033:x1875469110728064:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587151.000767:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15033:x1875469110728064:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 545us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587151.000776:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 135 00000100:00100000:2.0:1788587151.006521:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587151.006618:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728192 00000100:00100000:3.0:1788587151.006807:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728192 00000100:00100000:3.0:1788587151.006897:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 136 00000100:00100000:3.0:1788587151.006908:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15033:x1875469110728192:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587151.007057:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15033:x1875469110728192:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 151us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587151.007065:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 136 00000100:00100000:1.0:1788587151.025714:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587151.025816:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728320 00000100:00100000:0.0:1788587151.025827:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728320 00000100:00100000:0.0:1788587151.025882:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:0.0:1788587151.025892:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+11:15027:x1875469110728320:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587151.025908:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587151.025926:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdaec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c42 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587151.025974:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdaec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c42 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587151.025987:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4a00/0xfbc93bbea5fdaec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c42 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587151.025996:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4a00, rc 0) 00000100:00100000:0.0:1788587151.026061:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+12:15027:x1875469110728320:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587151.026069:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 137 00000100:00100000:0.0:1788587151.028844:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587151.028936:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728448 00000100:00100000:3.0:1788587151.028946:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728448 00000100:00100000:3.0:1788587151.028997:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 138 00000100:00100000:3.0:1788587151.029007:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+12:15027:x1875469110728448:12345-192.168.203.1@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788587151.029046:0:17186:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788587151.029062:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587151.029066:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788587151.029069:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788587151.029072:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788587151.029074:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788587151.033041:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+12:15027:x1875469110728448:12345-192.168.203.1@tcp:256:mount.lustre.0 Request processed in 4024us (4195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.033056:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 138 00000100:00100000:1.0:1788587151.036385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.036527:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728576 00000100:00100000:2.0:1788587151.036536:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728576 00000100:00100000:2.0:1788587151.036635:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 139 00000100:00100000:2.0:1788587151.036646:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+12:15027:x1875469110728576:12345-192.168.203.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587151.036662:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587151.036678:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c49 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.036707:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.036718:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.036728:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050800, rc 0) 00000100:00100000:2.0:1788587151.036782:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15027:x1875469110728576:12345-192.168.203.1@tcp:101:mount.lustre.0 Request processed in 138us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.036802:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 139 00000100:00100000:0.0:1788587151.044759:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.044955:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728704 00000100:00100000:2.0:1788587151.044965:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728704 00000100:00100000:2.0:1788587151.045019:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 140 00000100:00100000:2.0:1788587151.045030:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15027:x1875469110728704:12345-192.168.203.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587151.046331:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15027:x1875469110728704:12345-192.168.203.1@tcp:501:mount.lustre.0 Request processed in 1296us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.046341:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 140 00000100:00100000:3.0:1788587151.051066:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.051159:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728832 00000100:00100000:2.0:1788587151.051169:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728832 00000100:00100000:2.0:1788587151.051230:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 141 00000100:00100000:2.0:1788587151.051240:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15027:x1875469110728832:12345-192.168.203.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587151.051392:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15027:x1875469110728832:12345-192.168.203.1@tcp:503:mount.lustre.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.051409:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 141 00000100:00100000:1.0:1788587151.058545:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.058729:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110728960 00000100:00100000:2.0:1788587151.058740:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110728960 00000100:00100000:2.0:1788587151.058943:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 142 00000100:00100000:2.0:1788587151.058953:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15035:x1875469110728960:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587151.059099:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15035:x1875469110728960:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 147us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.059107:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 142 00000100:00100000:3.0:1788587151.072392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587151.072538:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729088 00000100:00100000:0.0:1788587151.072547:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729088 00000100:00100000:0.0:1788587151.072610:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 143 00000100:00100000:0.0:1788587151.072619:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15035:x1875469110729088:12345-192.168.203.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587151.072772:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+13:15035:x1875469110729088:12345-192.168.203.1@tcp:502:llog_process_th.0 Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587151.072779:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 143 00000100:00100000:3.0:1788587151.091974:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587151.092070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587151.093165:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729216 00000100:00100000:1.0:1788587151.093177:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729216 00000100:00100000:1.0:1788587151.093235:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729472 00000100:00100000:1.0:1788587151.093238:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729472 00000100:00100000:1.0:1788587151.093272:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:1.0:1788587151.093281:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1875469110729216:12345-192.168.203.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788587151.093310:0:19333:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 18de1d7d-8b16-47d2-9585-abe7106da5ca@192.168.203.1@tcp t0 exp 0000000000000000 cur 497 last 0 00000100:00100000:3.0:1788587151.093474:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:3.0:1788587151.093480:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1875469110729472:12345-192.168.203.1@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788587151.093498:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 18de1d7d-8b16-47d2-9585-abe7106da5ca@192.168.203.1@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:3.0:1788587151.093549:0:17193:0:(genops.c:1385:class_connect()) connect: client 18de1d7d-8b16-47d2-9585-abe7106da5ca, cookie 0xfbc93bbea5fdaecf 00000004:00100000:3.0:1788587151.093575:0:17193:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788587151.093665:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8f5baaae5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587151.093734:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2405:x1875469110729472:12345-192.168.203.1@tcp:38:mount.lustre.0 Request processed in 251us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587151.093743:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000020:00000080:1.0:1788587151.093951:0:19333:0:(genops.c:1385:class_connect()) connect: client 18de1d7d-8b16-47d2-9585-abe7106da5ca, cookie 0xfbc93bbea5fdaed6 00000004:00100000:1.0:1788587151.093963:0:19333:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788587151.094011:0:19333:0:(import.c:65:import_set_state_nolock()) ffff8f5bbfa0a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587151.094041:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2405:x1875469110729216:12345-192.168.203.1@tcp:38:mount.lustre.0 Request processed in 760us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587151.094048:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788587151.111955:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587151.111999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587151.112024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587151.112083:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729728 00000100:00100000:1.0:1788587151.112093:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729728 00000100:00100000:1.0:1788587151.112151:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729344 00000100:00100000:1.0:1788587151.112154:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729344 00000100:00100000:1.0:1788587151.112164:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729600 00000100:00100000:1.0:1788587151.112165:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729600 00000100:00100000:1.0:1788587151.112181:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:1.0:1788587151.112190:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+7:15027:x1875469110729728:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587151.112233:0:19333:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788587151.112305:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+7:15027:x1875469110729728:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587151.112312:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:1.0:1788587151.112336:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:1.0:1788587151.112342:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:0:x1875469110729344:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587151.112351:0:19333:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788587151.112368:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:0:x1875469110729344:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587151.112374:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:1.0:1788587151.112383:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:1.0:1788587151.112388:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:0:x1875469110729600:12345-192.168.203.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587151.112462:0:19333:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587151.112486:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:0:x1875469110729600:12345-192.168.203.1@tcp:41:mount.lustre.0 Request processed in 97us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587151.112492:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00080000:3.0:1788587151.113055:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587151.113060:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587151.114240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.115675:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729856 00000100:00100000:2.0:1788587151.115688:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729856 00000100:00100000:1.0:1788587151.115762:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:1.0:1788587151.115775:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15027:x1875469110729856:12345-192.168.203.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788587151.115871:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15027:x1875469110729856:12345-192.168.203.1@tcp:40:mount.lustre.0 Request processed in 100us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587151.115879:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:1.0:1788587151.123697:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587151.123803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587151.123873:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730240 00000100:00100000:0.0:1788587151.123883:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730240 00000100:00100000:0.0:1788587151.123938:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:0.0:1788587151.123948:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15027:x1875469110730240:12345-192.168.203.1@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788587151.124026:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15027:x1875469110730240:12345-192.168.203.1@tcp:900:mount.lustre.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587151.124048:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:3.0:1788587151.125658:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587151.125862:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730368 00000100:00100000:0.0:1788587151.125870:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730368 00000100:00100000:0.0:1788587151.125920:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:0.0:1788587151.125929:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15027:x1875469110730368:12345-192.168.203.1@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788587151.126011:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788587151.126085:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15027:x1875469110730368:12345-192.168.203.1@tcp:33:mount.lustre.0 Request processed in 157us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587151.126093:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:2.0:1788587151.126791:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110729984 00000100:00100000:2.0:1788587151.126799:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110729984 00000100:00100000:2.0:1788587151.126835:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:2.0:1788587151.126840:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2405:x1875469110729984:12345-192.168.203.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587151.126866:0:19770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 18de1d7d-8b16-47d2-9585-abe7106da5ca@192.168.203.1@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1788587151.126896:0:19770:0:(genops.c:1385:class_connect()) connect: client 18de1d7d-8b16-47d2-9585-abe7106da5ca, cookie 0xfbc93bbea5fdaedd 00002000:00100000:2.0:1788587151.126908:0:19770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 18de1d7d-8b16-47d2-9585-abe7106da5ca/ffff8f5a8300d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587151.126919:0:19770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587151.127010:0:19770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788587151.127058:0:19770:0:(import.c:65:import_set_state_nolock()) ffff8f5b83587800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587151.127094:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2405:x1875469110729984:12345-192.168.203.1@tcp:8:mount.lustre.0 Request processed in 253us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.127101:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00000040:00080000:1.0:1788587151.127970:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788587151.129858:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 18de1d7d-8b16-47d2-9585-abe7106da5ca 00000001:00100000:2.0:1788587151.129869:0:18693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cea8b0dc-76f5-470d-a41c-45365485d47c 00000100:00100000:1.0:1788587151.131108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.131184:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730112 00000100:00100000:2.0:1788587151.131193:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730112 00000100:00100000:2.0:1788587151.131239:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:2.0:1788587151.131247:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1875469110730112:12345-192.168.203.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587151.131374:0:18699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 18de1d7d-8b16-47d2-9585-abe7106da5ca@192.168.203.1@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1788587151.131450:0:18699:0:(genops.c:1385:class_connect()) connect: client 18de1d7d-8b16-47d2-9585-abe7106da5ca, cookie 0xfbc93bbea5fdaee4 00002000:00100000:2.0:1788587151.131472:0:18699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 18de1d7d-8b16-47d2-9585-abe7106da5ca/ffff8f5b83584000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587151.131495:0:18699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587151.132825:0:18699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587151.132866:0:18699:0:(import.c:65:import_set_state_nolock()) ffff8f5b83581000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587151.132963:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2405:x1875469110730112:12345-192.168.203.1@tcp:8:mount.lustre.0 Request processed in 1715us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.132974:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000001:00100000:2.0:1788587151.146039:0:19513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 18de1d7d-8b16-47d2-9585-abe7106da5ca 00000001:00100000:2.0:1788587151.146060:0:19513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cea8b0dc-76f5-470d-a41c-45365485d47c 00000001:00080000:2.0:1788587151.146070:0:19513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788587151.290807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587151.294406:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730496 00000100:00100000:2.0:1788587151.294434:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730496 00000100:00100000:2.0:1788587151.294517:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:2.0:1788587151.294529:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15058:x1875469110730496:12345-192.168.203.1@tcp:101:mkdir.0 00010000:00010000:2.0:1788587151.294551:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587151.294576:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdaeeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c7a expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.294664:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.294682:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.294698:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587151.294750:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788587151.294754:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587151.294775:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.294801:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdaeeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.294840:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.296139:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:2.0:1788587151.296142:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587151.296154:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050000, rc 0) 00000100:00100000:2.0:1788587151.296237:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+7:15058:x1875469110730496:12345-192.168.203.1@tcp:101:mkdir.0 Request processed in 1707us (5436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587151.296245:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00010000:00010000:1.0:1788587151.764702:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587152.788661:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587153.753349:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127576832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587153.753449:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587153.753820:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576832 00000100:00100000:3.0:1788587153.753834:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576832 00000100:00100000:3.0:1788587153.753906:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587153.753915:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127576832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587153.753940:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788587153.754118:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127576832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 203us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587153.754125:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788587153.754152:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587153.756066:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127576832:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788587153.795395:0:20069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788587153.813229:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587154.260975:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127577088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587154.261046:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.261163:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577088 00000100:00100000:1.0:1788587154.261170:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577088 00000100:00100000:1.0:1788587154.261222:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587154.261232:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127577088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587154.261262:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587154.261309:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127577088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587154.261316:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587154.261366:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127577088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587154.261534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127576960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587154.261562:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587154.261870:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127576960 00000100:00100000:1.0:1788587154.261875:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127576960 00000100:00100000:1.0:1788587154.261914:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587154.261922:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127576960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587154.261941:0:17931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788587154.261981:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127576960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587154.261988:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587154.263449:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127576960:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788587154.265832:0:17171:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 18de1d7d-8b16-47d2-9585-abe7106da5ca 00000001:00100000:1.0:1788587154.265844:0:17171:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cea8b0dc-76f5-470d-a41c-45365485d47c 00000001:00100000:2.0:1788587154.267009:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 18de1d7d-8b16-47d2-9585-abe7106da5ca 00000001:00100000:2.0:1788587154.267019:0:17923:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cea8b0dc-76f5-470d-a41c-45365485d47c 00010000:00010000:1.0:1788587154.838716:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587155.284624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127577216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587155.284698:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587155.284772:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577216 00000100:00100000:1.0:1788587155.284780:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577216 00000100:00100000:1.0:1788587155.284833:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587155.284842:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127577216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587155.284870:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788587155.284915:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127577216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.284922:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788587155.284941:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587155.284973:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127577216:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788587155.285129:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587155.285595:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127577600:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.285633:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587155.285919:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127577728:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.285953:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587155.286088:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127577344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587155.286123:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587155.293739:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127578112:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.293819:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587155.293862:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127578624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.293890:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587155.293942:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577600 00000100:00100000:1.0:1788587155.293951:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577600 00000100:00100000:1.0:1788587155.294001:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587155.294011:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127577600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.294071:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127577600:12345-0@lo:400:kworker.0 Request processed in 61us (8436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.294079:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587155.294101:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577728 00000100:00100000:1.0:1788587155.294105:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577728 00000100:00100000:1.0:1788587155.294138:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578112 00000100:00100000:1.0:1788587155.294141:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578112 00000100:00100000:1.0:1788587155.294167:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587155.294174:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127577728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.294207:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127577728:12345-0@lo:400:kworker.0 Request processed in 33us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.294213:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587155.294225:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587155.294231:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127578112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.294256:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127578112:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.294263:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587155.294281:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578624 00000100:00100000:1.0:1788587155.294284:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578624 00000100:00100000:1.0:1788587155.294328:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587155.294335:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127578624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.294365:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127578624:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.294385:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788587155.294444:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587155.294449:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587155.294451:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587155.294461:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577344 00000100:00100000:1.0:1788587155.294465:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577344 00000100:00100000:1.0:1788587155.294494:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587155.294500:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127577344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587155.294523:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788587155.294555:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127577344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (8432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.294561:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788587155.294579:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587155.294607:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127577600:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.294618:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127578112:0@lo:400:kworker.0 00010000:00080000:1.0:1788587155.294630:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83de2680 x1875469127578624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587155.294640:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127578624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.294826:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788587155.294840:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127577728:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.294848:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127578240:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.294876:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587155.294897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127578752:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.294922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587155.294956:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578240 00000100:00100000:0.0:1788587155.294960:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578240 00000100:00100000:0.0:1788587155.294987:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587155.294993:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.295038:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127578240:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587155.295045:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587155.295068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127578240:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.295261:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578752 00000100:00100000:1.0:1788587155.295265:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578752 00000100:00100000:1.0:1788587155.295312:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587155.295319:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127578752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.295362:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875469127578752:12345-0@lo:400:kworker.0 Request processed in 44us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.295379:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587155.295440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875469127578752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.295808:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127577472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.295848:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587155.295875:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127577984:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.295899:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587155.295918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127578496:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.295939:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587155.295954:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127579008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587155.295975:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587155.296015:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577472 00000100:00100000:2.0:1788587155.296019:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577472 00000100:00100000:2.0:1788587155.296049:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788587155.296056:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3647:x1875469127577472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.296092:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3647:x1875469127577472:12345-0@lo:400:kworker.0 Request processed in 36us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587155.296098:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788587155.296128:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577984 00000100:00100000:2.0:1788587155.296132:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577984 00000100:00100000:2.0:1788587155.296152:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587155.296158:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127577984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.296190:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127577984:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587155.296195:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587155.296220:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127577472:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.296230:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127577984:0@lo:400:kworker.0 00000100:00100000:3.0:1788587155.297124:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127577344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587155.297138:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127577856:0@lo:400:kworker.0 00000100:00100000:3.0:1788587155.297179:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587155.297211:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127578368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587155.297233:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587155.297248:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127578880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587155.297273:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587155.297523:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578496 00000100:00100000:1.0:1788587155.297529:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578496 00000100:00100000:1.0:1788587155.297560:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127577856 00000100:00100000:1.0:1788587155.297563:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127577856 00000100:00100000:1.0:1788587155.297576:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578368 00000100:00100000:1.0:1788587155.297578:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578368 00000100:00100000:1.0:1788587155.297589:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127578880 00000100:00100000:1.0:1788587155.297591:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127578880 00000100:00100000:1.0:1788587155.297607:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587155.297615:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127578496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.297667:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127578496:12345-0@lo:400:kworker.0 Request processed in 53us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.297675:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587155.297691:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587155.297698:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127577856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.297730:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875469127577856:12345-0@lo:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.297736:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587155.297748:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587155.297754:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127578368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.297781:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875469127578368:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.297799:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587155.297813:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587155.297820:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127578880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.297846:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875469127578880:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.297851:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587155.297881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127578496:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.297928:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127579008 00000100:00100000:1.0:1788587155.297932:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127579008 00000100:00100000:1.0:1788587155.297960:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587155.297967:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127579008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587155.297982:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788587155.298020:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127579008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587155.298027:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587155.298060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127579008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587155.298092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875469127577856:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.298103:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875469127578368:0@lo:400:kworker.0 00010000:00080000:1.0:1788587155.298115:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83de1880 x1875469127578880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587155.298127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875469127578880:0@lo:400:kworker.0 00000100:00080000:0.0:1788587155.298264:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587155.298269:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587155.861739:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587156.583929:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584035:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584078:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584106:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584134:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584160:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584184:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584204:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584235:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587156.584279:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731136 00000100:00100000:1.0:1788587156.584289:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731136 00000100:00100000:3.0:1788587156.584321:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730880 00000100:00100000:3.0:1788587156.584328:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730880 00000100:00100000:1.0:1788587156.584356:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731648 00000100:00100000:1.0:1788587156.584370:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731648 00000100:00100000:2.0:1788587156.584372:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731008 00000100:00100000:3.0:1788587156.584378:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731392 00000100:00100000:2.0:1788587156.584379:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731008 00000100:00100000:3.0:1788587156.584385:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731392 00000100:00100000:1.0:1788587156.584405:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731520 00000100:00100000:1.0:1788587156.584442:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731520 00000100:00100000:3.0:1788587156.584445:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730752 00000100:00100000:3.0:1788587156.584451:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730752 00000100:00100000:2.0:1788587156.584454:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:3.0:1788587156.584482:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731264 00000100:00100000:3.0:1788587156.584484:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731264 00000100:00100000:3.0:1788587156.584503:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:3.0:1788587156.584509:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110730880:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587156.584570:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110730880:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 62us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587156.584575:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:3.0:1788587156.584586:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:3.0:1788587156.584590:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2408:x1875469110731392:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587156.584602:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2408:x1875469110731392:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 13us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587156.584606:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:3.0:1788587156.584611:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:3.0:1788587156.584615:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2408:x1875469110730752:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587156.584625:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2408:x1875469110730752:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 10us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587156.584628:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:3.0:1788587156.584633:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:3.0:1788587156.584637:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2408:x1875469110731264:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587156.584646:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2408:x1875469110731264:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 9us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587156.584650:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:0.0:1788587156.584974:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110730624 00000100:00100000:0.0:1788587156.584980:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110730624 00000100:00100000:0.0:1788587156.585114:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 145 00000100:00100000:0.0:1788587156.585124:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:2408:x1875469110730624:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587156.585158:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:2408:x1875469110730624:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 37us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587156.585165:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 145 00000100:00100000:2.0:1788587156.585231:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110731136:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587156.585251:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:2.0:1788587156.585268:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110731136:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 42us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587156.585276:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2408:x1875469110731648:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587156.585283:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:2.0:1788587156.585303:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:2.0:1788587156.585312:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110731008:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1788587156.585317:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2408:x1875469110731648:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 47us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587156.585330:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:1.0:1788587156.585349:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:1.0:1788587156.585358:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2408:x1875469110731520:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1788587156.585374:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110731008:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 51us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587156.585387:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:1.0:1788587156.585436:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2408:x1875469110731520:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 52us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587156.585444:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00080000:1.0:1788587156.585655:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587156.585660:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587156.585663:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587156.585665:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788587156.885139:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587157.193059:0:20216:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecde1dad0 20000000:00000080:2.0:1788587157.193076:0:20216:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f5b83417400 uarg=0000000000000000 20000000:01000000:2.0:1788587157.193121:0:20216:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587157.193126:0:20216:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587157.193131:0:20216:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788587157.194293:0:20217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788587157.194479:0:20216:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788587157.200775:0:20216:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788587157.200905:0:20216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200926:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200935:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200941:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200948:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200972:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200979:0:20216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.200987:0:20216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201031:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201047:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 12 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.201063:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579136:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587157.201164:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201173:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 12 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.201181:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579264:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587157.201214:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201222:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.201243:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a1ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579392:0@lo:104: 00000100:00100000:0.0:1788587157.201282:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587157.201322:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201331:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.201338:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579520:0@lo:104: 00000100:00100000:0.0:1788587157.201370:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587157.201458:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201466:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.201474:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5ba7a18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579648:0@lo:104: 00000100:00100000:0.0:1788587157.201494:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587157.201931:0:20216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.201941:0:20216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.201949:0:20216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579776:0@lo:104: 00000100:00100000:0.0:1788587157.201971:0:20216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587157.202055:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127579392 00000100:00100000:2.0:1788587157.202063:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127579392 00000100:00100000:2.0:1788587157.202106:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127579520 00000100:00100000:2.0:1788587157.202109:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127579520 00000100:00100000:2.0:1788587157.202119:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127579648 00000100:00100000:2.0:1788587157.202121:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127579648 00000100:00100000:2.0:1788587157.202133:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587157.202142:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+5:20216:x1875469127579392:12345-0@lo:104: 00010000:00010000:2.0:1788587157.202156:0:18722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202204:0:18722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587157.202211:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+5:20216:x1875469127579392:12345-0@lo:104: Request processed in 71us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.202217:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587157.202232:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587157.202237:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+4:20216:x1875469127579520:12345-0@lo:104: 00010000:00010000:2.0:1788587157.202244:0:18722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202285:0:18722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788587157.202291:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+4:20216:x1875469127579520:12345-0@lo:104: Request processed in 53us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.202297:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587157.202310:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587157.202315:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+3:20216:x1875469127579648:12345-0@lo:104: 00010000:00010000:2.0:1788587157.202323:0:18722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202352:0:18722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788587157.202606:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+3:20216:x1875469127579648:12345-0@lo:104: Request processed in 42us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.202613:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788587157.202631:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587157.202637:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202644:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70e00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587157.202648:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202657:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587157.202664:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587157.202669:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587157.202706:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202713:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587157.202733:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202740:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa70e00/0xfbc93bbea5fdac6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdac75 expref: -99 pid: 19512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202754:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587157.202758:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202763:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a466c00 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587157.202767:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.202773:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587157.202779:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587157.202784:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587157.202795:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587157.202922:0:20216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5ba0554840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587157.202944:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579392:0@lo:104: 00000100:00100000:0.0:1788587157.202964:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579520:0@lo:104: 00000100:00100000:0.0:1788587157.202971:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a18380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579648:0@lo:104: 00010000:00010000:2.0:1788587157.203069:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587157.203079:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203096:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8a466c00/0xfbc93bbea5fdabd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdabdb expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203107:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587157.203110:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203116:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5000 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587157.203120:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203128:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587157.203134:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587157.203140:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587157.203154:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203159:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587157.203186:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203194:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdab95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab9c expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203203:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587157.203212:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587157.203214:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587157.203220:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587157.203230:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127579776 00000100:00100000:2.0:1788587157.203234:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127579776 00000100:00100000:2.0:1788587157.203258:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587157.203264:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+3:20216:x1875469127579776:12345-0@lo:104: 00010000:00010000:2.0:1788587157.203273:0:18722:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203312:0:18722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788587157.203317:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:bf956867-663d-4ecf-b775-8366b2c643ae+3:20216:x1875469127579776:12345-0@lo:104: Request processed in 54us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.203322:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788587157.203335:0:17180:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587157.203339:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203345:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b8a467400 already unused, calling callback (ffffffffc13dec20) 10000000:00010000:2.0:1788587157.203348:0:17180:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203373:0:17180:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587157.203381:0:17180:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587157.203386:0:17180:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587157.203399:0:17180:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203411:0:17180:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587157.203436:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203442:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.101@tcp lock: ffff8f5b8a467400/0xfbc93bbea5fdab87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfbc93bbea5fdab8e expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.203458:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587157.203460:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587157.203461:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587157.203897:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127580160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.203934:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587157.204053:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580160 00000100:00100000:2.0:1788587157.204058:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580160 00010000:00010000:2.0:1788587157.204081:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 24 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.204108:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587157.204115:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3646:x1875469127580160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587157.204126:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587157.204131:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 24 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.204140:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 24 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.204153:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1ae00/0xfbc93bbea5fdab9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdab95 expref: 24 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.204166:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587157.204193:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+23:3646:x1875469127580160:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.204207:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587157.204624:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587157.204638:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127580288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.204669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587157.204710:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127580160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.204756:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84464a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579776:0@lo:104: 00000100:00100000:2.0:1788587157.204888:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580288 00000100:00100000:2.0:1788587157.204893:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580288 00010000:00010000:2.0:1788587157.204914:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.204944:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587157.204951:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+23:3646:x1875469127580288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587157.204960:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587157.204965:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.205050:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.205065:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5a83c1ba00/0xfbc93bbea5fdab8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdab87 expref: 23 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.205077:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587157.205115:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf956867-663d-4ecf-b775-8366b2c643ae+22:3646:x1875469127580288:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.205122:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587157.205149:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bf956867-663d-4ecf-b775-8366b2c643ae:3646:1875469127580288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.205957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127579904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.206073:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587157.206150:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587157.206157:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127580032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.206184:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587157.206323:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587157.206728:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127579904 00000100:00100000:2.0:1788587157.206736:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127579904 00010000:00010000:2.0:1788587157.206766:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 22 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.206796:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580032 00000100:00100000:2.0:1788587157.206818:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580032 00010000:00010000:2.0:1788587157.206833:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.206849:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587157.206856:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+23:3648:x1875469127579904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587157.206868:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587157.206872:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.206882:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.206898:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b8a467200/0xfbc93bbea5fdac75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdac6e expref: 23 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.206910:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587157.206951:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+22:3648:x1875469127579904:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.206957:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587157.207049:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587157.207056:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+21:3648:x1875469127580032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587157.207064:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587157.207069:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 21 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.207078:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 21 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.207088:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5200/0xfbc93bbea5fdabdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xfbc93bbea5fdabd4 expref: 21 pid: 17186 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.207103:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587157.207127:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf956867-663d-4ecf-b775-8366b2c643ae+20:3648:x1875469127580032:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.207133:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587157.207166:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127580032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587157.207174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127579904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587157.208330:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579136:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587157.208343:0:20216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5ba7a1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20216:1875469127579264:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587157.208387:0:20216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587157.211129:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587157.211234:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587157.211402:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731776 00000100:00100000:2.0:1788587157.211412:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731776 00010000:00010000:2.0:1788587157.211467:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 13 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.211495:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110731904 00000100:00100000:2.0:1788587157.211497:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110731904 00010000:00010000:2.0:1788587157.211509:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 14 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.211537:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 13 00000100:00100000:2.0:1788587157.211546:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb5b55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38609982-39d4-4f97-a9ad-eea20d935b3f+14:2409:x1875469110731776:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587157.211576:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587157.211584:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 14 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.211596:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 14 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587157.211607:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00010000:00010000:2.0:1788587157.211613:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050800/0xfbc93bbea5fdaec8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c49 expref: 14 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587157.211615:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38609982-39d4-4f97-a9ad-eea20d935b3f+14:2409:x1875469110731904:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587157.211624:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587157.211632:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 13 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.211638:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587157.211640:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 13 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211649:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5bc2050c00/0xfbc93bbea5fdae89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810bd9 expref: 13 pid: 17184 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211659:0:19528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211667:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211680:0:19528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211687:0:19528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587157.211687:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb5b55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38609982-39d4-4f97-a9ad-eea20d935b3f+12:2409:x1875469110731776:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 142us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587157.211694:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 13 00010000:00010000:3.0:1788587157.211695:0:19528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211701:0:19528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211706:0:19528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b829f5e00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587157.211710:0:19528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211718:0:19528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211736:0:19528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587157.211749:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587157.211770:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38609982-39d4-4f97-a9ad-eea20d935b3f+11:2409:x1875469110731904:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 156us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587157.211776:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00010000:00010000:0.0:1788587157.213217:0:20216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.213232:0:20216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587157.213253:0:20216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f5b829f5e00/0xfbc93bbea5fdaef9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587157.909005:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587158.378483:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587158.378573:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732032 00000100:00100000:0.0:1788587158.378584:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732032 00000100:00100000:0.0:1788587158.378640:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 146 00000100:00100000:0.0:1788587158.378650:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+11:14911:x1875469110732032:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587158.378667:0:17185:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587158.378685:0:17185:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4800/0xfbc93bbea5fdaf00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c81 expref: -99 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.378721:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4800/0xfbc93bbea5fdaf00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c81 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.378732:0:17185:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4800/0xfbc93bbea5fdaf00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c81 expref: 12 pid: 17185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.378742:0:17185:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4800, rc 0) 00000100:00100000:0.0:1788587158.378889:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+12:14911:x1875469110732032:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 239us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.378897:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 146 00000100:00100000:3.0:1788587158.381612:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587158.381678:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732160 00000100:00100000:0.0:1788587158.381689:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732160 00000100:00100000:0.0:1788587158.381755:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 147 00000100:00100000:0.0:1788587158.381767:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+12:14911:x1875469110732160:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.382902:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+12:14911:x1875469110732160:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 1132us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.382920:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 147 00000100:00100000:3.0:1788587158.388603:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587158.388878:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732288 00000100:00100000:0.0:1788587158.388887:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732288 00000100:00100000:0.0:1788587158.388939:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 148 00000100:00100000:0.0:1788587158.388949:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+12:14911:x1875469110732288:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.389080:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+12:14911:x1875469110732288:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 130us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.389087:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 148 00000100:00100000:1.0:1788587158.405024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587158.405369:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732416 00000100:00100000:0.0:1788587158.405380:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732416 00000100:00100000:0.0:1788587158.405471:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 149 00000100:00100000:0.0:1788587158.405482:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+12:14911:x1875469110732416:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587158.405500:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587158.405518:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fdaf07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c88 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.405548:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fdaf07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c88 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.405560:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4e00/0xfbc93bbea5fdaf07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c88 expref: 13 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.405570:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4e00, rc 0) 00000100:00100000:0.0:1788587158.405628:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38609982-39d4-4f97-a9ad-eea20d935b3f+13:14911:x1875469110732416:12345-192.168.203.1@tcp:101:ll_cfg_requeue.0 Request processed in 148us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.405636:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 149 00000100:00100000:1.0:1788587158.413184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587158.413359:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732544 00000100:00100000:3.0:1788587158.413370:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732544 00000100:00100000:3.0:1788587158.414394:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 150 00000100:00100000:3.0:1788587158.414409:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:14911:x1875469110732544:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.414594:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38609982-39d4-4f97-a9ad-eea20d935b3f+13:14911:x1875469110732544:12345-192.168.203.1@tcp:501:ll_cfg_requeue.0 Request processed in 189us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587158.414602:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 150 00000100:00100000:1.0:1788587158.425509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587158.425554:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732672 00000100:00100000:1.0:1788587158.425563:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732672 00000100:00100000:1.0:1788587158.425611:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 151 00000100:00100000:1.0:1788587158.425621:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+13:14911:x1875469110732672:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587158.425769:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+13:14911:x1875469110732672:12345-192.168.203.1@tcp:503:ll_cfg_requeue.0 Request processed in 148us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587158.425777:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 151 10000000:01000000:3.0:1788587158.548475:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587158.548482:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a83ce1000 from 13 10000000:01000000:3.0:1788587158.548487:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587158.548531:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.548544:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.548556:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587158.548593:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.548659:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587158.548704:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587158.548833:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580416 00000100:00100000:1.0:1788587158.548841:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580416 00000100:00100000:1.0:1788587158.548895:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587158.548904:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+20:17188:x1875469127580416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587158.549395:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587158.553167:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5a8224d600/0xfbc93bbea5fdaf15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaf0e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587158.553217:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5a8224d600/0xfbc93bbea5fdaf15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf0e expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587158.553232:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5a8224d600/0xfbc93bbea5fdaf15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf0e expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587158.553243:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224d600, rc 0) 00000100:00100000:1.0:1788587158.553506:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127580416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4600us (4844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587158.553523:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788587158.553691:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587158.553713:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf15 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.553724:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaf15 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587158.553810:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.553846:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587158.553881:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587158.554000:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580544 00000100:00100000:1.0:1788587158.554007:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580544 00000100:00100000:1.0:1788587158.554155:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788587158.554164:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127580544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587158.554448:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127580544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587158.554456:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788587158.554576:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.554606:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.554648:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587158.554714:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587158.554743:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580672 00000100:00100000:1.0:1788587158.554748:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580672 00000100:00100000:1.0:1788587158.554805:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788587158.554812:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a82576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127580672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587158.554891:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a82576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127580672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587158.554898:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788587158.555142:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587158.558612:0:20279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788587158.558752:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788587158.558787:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587158.558798:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf15 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.558810:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5bbfa71400/0xfbc93bbea5fdaf0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf15 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587158.558820:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587158.558823:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a81bce000 from 13 10000000:01000000:0.0:1788587158.558826:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587158.558862:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.558870:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.558881:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587158.558906:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.558975:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587158.559068:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587158.562009:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580800 00000100:00100000:3.0:1788587158.562023:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580800 00000100:00100000:3.0:1788587158.562082:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587158.562092:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+21:17188:x1875469127580800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587158.562109:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587158.562127:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71600/0xfbc93bbea5fdaf23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaf1c expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.562166:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71600/0xfbc93bbea5fdaf23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf1c expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.562177:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa71600/0xfbc93bbea5fdaf23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf1c expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.562187:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71600, rc 0) 00000100:00100000:3.0:1788587158.562264:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+22:17188:x1875469127580800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (3289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587158.562271:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788587158.562389:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587158.562407:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf23 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.562445:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaf23 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587158.562527:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.562562:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587158.562588:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587158.562602:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127580928 00000100:00100000:0.0:1788587158.562606:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127580928 00000100:00100000:0.0:1788587158.562630:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587158.562637:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127580928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.562747:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127580928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.562754:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587158.562790:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127580928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.562817:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.562855:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587158.562868:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d71540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587158.562880:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581056 00000100:00100000:0.0:1788587158.562883:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581056 00000100:00100000:0.0:1788587158.562902:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788587158.562908:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.562981:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.562988:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788587158.563026:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587158.563939:0:20280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788587158.564018:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788587158.564036:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587158.564045:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf23 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.564055:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5200/0xfbc93bbea5fdaf1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf23 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587158.564066:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587158.564068:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5bb05d5000 from 13 10000000:01000000:0.0:1788587158.564071:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587158.564099:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.564108:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.564118:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587158.564135:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.564174:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587158.564203:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b86d713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587158.564219:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581184 00000100:00100000:0.0:1788587158.564224:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581184 00000100:00100000:0.0:1788587158.564252:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788587158.564260:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587158.564269:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587158.564500:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fdaf31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaf2a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.564534:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fdaf31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf2a expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.564544:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5b829f4400/0xfbc93bbea5fdaf31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf2a expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.564553:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4400, rc 0) 00000100:00100000:0.0:1788587158.564633:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 373us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.564640:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788587158.566580:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587158.566607:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf31 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.566620:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaf31 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587158.566770:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.566821:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587158.566861:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587158.566881:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581312 00000100:00100000:3.0:1788587158.566886:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581312 00000100:00100000:3.0:1788587158.566929:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587158.566938:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.567063:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587158.567081:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587158.567133:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.567161:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.567199:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587158.567217:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587158.567230:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581440 00000100:00100000:3.0:1788587158.567234:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581440 00000100:00100000:3.0:1788587158.567262:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587158.567268:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.567625:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 356us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587158.567633:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788587158.568062:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587158.569177:0:20281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788587158.569512:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788587158.569543:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587158.569554:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf31 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.569567:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5000/0xfbc93bbea5fdaf2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf31 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587158.569578:0:17188:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587158.569580:0:17188:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f5a8450b800 from 13 10000000:01000000:0.0:1788587158.569583:0:17188:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587158.569618:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.569627:0:17188:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587158.569649:0:17188:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587158.569790:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.569847:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587158.569915:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587158.569951:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581568 00000100:00100000:3.0:1788587158.569959:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581568 00000100:00100000:3.0:1788587158.570039:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788587158.570049:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+23:17188:x1875469127581568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587158.570062:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587158.570076:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f5bbfa71e00/0xfbc93bbea5fdaf3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xfbc93bbea5fdaf38 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.570100:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f5bbfa71e00/0xfbc93bbea5fdaf3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf38 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.570110:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f5bbfa71e00/0xfbc93bbea5fdaf3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xfbc93bbea5fdaf38 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587158.570131:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bbfa71e00, rc 0) 00000100:00100000:3.0:1788587158.570182:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127581568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587158.570189:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788587158.570255:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587158.570269:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf3f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587158.570287:0:17188:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xfbc93bbea5fdaf3f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587158.570344:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587158.570388:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587158.571064:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587158.571097:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581696 00000100:00100000:0.0:1788587158.571104:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581696 00000100:00100000:0.0:1788587158.571135:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788587158.571142:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127581696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587158.571305:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127581696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587158.571313:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788587158.573016:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587158.573073:0:17188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587158.573138:0:17188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587158.573219:0:17188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587158.573992:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581824 00000100:00100000:3.0:1788587158.574000:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581824 00000100:00100000:3.0:1788587158.574258:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788587158.574268:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127581824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587158.574817:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:17188:x1875469127581824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587158.574828:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788587158.575003:0:17188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bf956867-663d-4ecf-b775-8366b2c643ae:17188:1875469127581824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587158.577814:0:20282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788587158.578062:0:17188:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788587158.578089:0:17188:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587158.578101:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf3f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587158.578114:0:17188:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.101@tcp lock: ffff8f5b829f5e00/0xfbc93bbea5fdaf38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xfbc93bbea5fdaf3f expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587158.877235:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127581952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587158.877315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587158.877552:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127581952 00000100:00100000:1.0:1788587158.877561:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127581952 00000100:00100000:1.0:1788587158.877619:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587158.877631:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127581952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587158.877661:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788587158.879481:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127581952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1847us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587158.879493:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788587158.879521:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587158.880206:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127581952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788587158.933750:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587159.381833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127582208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587159.381907:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587159.387976:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127582080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587159.389097:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582208 00000100:00100000:1.0:1788587159.389107:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582208 00000100:00100000:1.0:1788587159.389165:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587159.389174:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127582208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587159.389210:0:17931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788587159.389281:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127582208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (7373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587159.389287:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587159.389314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587159.389370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127582208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587159.389370:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582080 00000100:00100000:1.0:1788587159.389377:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582080 00000100:00100000:1.0:1788587159.389407:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587159.389575:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127582080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587159.389596:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587159.389643:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875469127582080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 230us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587159.389649:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587159.389711:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a8452b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875469127582080:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587159.958730:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587160.404725:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a84528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127582336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587160.404791:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587160.404994:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582336 00000100:00100000:1.0:1788587160.405001:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582336 00000100:00100000:1.0:1788587160.405072:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587160.405084:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127582336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587160.405110:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788587160.405139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587160.405177:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127582336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.405185:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587160.405191:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587160.405207:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582464 00000100:00100000:1.0:1788587160.405211:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582464 00000100:00100000:1.0:1788587160.405250:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587160.405258:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127582464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587160.405275:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788587160.405312:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127582464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.405319:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587160.405351:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127582976:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.405389:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587160.405443:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127583488:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.405468:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587160.405515:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587160.405533:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788587160.405539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127582592:0@lo:400:kworker.0 00000100:00080000:2.0:1788587160.405554:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587160.405559:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587160.405573:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127582848:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.405582:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587160.408393:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587160.409101:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127583360:0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409153:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587160.409177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127583872:0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409201:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587160.409258:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a84528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127582336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587160.409267:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582976 00000100:00100000:1.0:1788587160.409276:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582976 00000100:00100000:2.0:1788587160.409289:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788587160.409298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127582720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587160.409329:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587160.409331:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587160.409352:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409378:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127583232:0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587160.409461:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127583744:0@lo:400:kworker.0 00000100:00100000:1.0:1788587160.409468:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127582976:12345-0@lo:400:kworker.0 Request processed in 117us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.409476:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587160.409489:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587160.409507:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582720 00000100:00100000:1.0:1788587160.409512:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582720 00000100:00100000:2.0:1788587160.409523:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583488 00000100:00100000:2.0:1788587160.409529:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583488 00000100:00100000:1.0:1788587160.409533:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587160.409542:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127582720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409568:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582848 00000100:00100000:2.0:1788587160.409573:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582848 00000100:00100000:2.0:1788587160.409587:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583360 00000100:00100000:2.0:1788587160.409590:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583360 00000100:00100000:1.0:1788587160.409598:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127582720:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.409602:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583872 00000100:00100000:2.0:1788587160.409607:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583872 00000100:00100000:1.0:1788587160.409607:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587160.409628:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583744 00000100:00100000:2.0:1788587160.409631:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583744 00000100:00100000:2.0:1788587160.409652:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587160.409653:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127582720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409663:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127583488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.409704:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875469127583488:12345-0@lo:400:kworker.0 Request processed in 43us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.409721:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587160.410090:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127582848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587160.410133:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875469127582848:12345-0@lo:400:kworker.0 Request processed in 49us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.411203:0:17193:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587160.411212:0:17193:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788587160.411237:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587160.411254:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127584000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587160.411301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587160.411371:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875469127582848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587160.411428:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127584000 00000100:00100000:0.0:1788587160.411434:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127584000 00000100:00100000:0.0:1788587160.411508:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587160.411515:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875469127584000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587160.411533:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788587160.412908:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587160.412946:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587160.412962:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127583360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.413758:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127583104:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.413822:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587160.413860:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127583616:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.413883:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587160.413916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127582976:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.413931:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875469127583488:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.413970:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788587160.413980:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583616 00000100:00100000:3.0:1788587160.413986:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583616 00000100:00100000:3.0:1788587160.414022:0:17192:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788587160.414029:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587160.414036:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127583872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587160.416665:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587160.416915:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788587160.416931:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587160.416946:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127583744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.416960:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875469127583360:12345-0@lo:400:kworker.0 Request processed in 4002us (7802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.416971:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587160.416989:0:19333:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788587160.417000:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587160.417010:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127583616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587160.417057:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875469127583616:12345-0@lo:400:kworker.0 Request processed in 50us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.417071:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587160.417102:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583232 00000100:00100000:2.0:1788587160.417110:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583232 00000100:00100000:2.0:1788587160.417155:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127583104 00000100:00100000:2.0:1788587160.417159:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127583104 00000100:00100000:2.0:1788587160.417181:0:19394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587160.417188:0:19394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1875469127583232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587160.417275:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875469127584000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5759us (5971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587160.417284:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587160.417349:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875469127584000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587160.417448:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875469127583872:12345-0@lo:400:kworker.0 Request processed in 3410us (8244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.417455:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587160.417476:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127582592 00000100:00100000:3.0:1788587160.417491:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127582592 00000100:00100000:3.0:1788587160.417519:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587160.417525:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3648:x1875469127582592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.417559:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf956867-663d-4ecf-b775-8366b2c643ae+24:3648:x1875469127582592:12345-0@lo:400:kworker.0 Request processed in 34us (11978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.417576:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788587160.417609:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587160.417616:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127583104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.417644:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127583104:12345-0@lo:400:kworker.0 Request processed in 29us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587160.417660:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587160.417692:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bf956867-663d-4ecf-b775-8366b2c643ae:3648:1875469127582592:0@lo:400:kworker.0 00000100:00100000:3.0:1788587160.417704:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127583104:0@lo:400:kworker.0 00010000:00080000:3.0:1788587160.417730:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83de1c00 x1875469127583616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587160.417742:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875469127583616:0@lo:400:kworker.0 00000100:00080000:3.0:1788587160.417851:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587160.417855:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587160.417858:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587160.417861:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587160.418992:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875469127583744:12345-0@lo:400:kworker.0 Request processed in 2046us (9496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587160.419004:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587160.419277:0:19394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127583232:12345-0@lo:400:kworker.0 Request processed in 2087us (9869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587160.419286:0:19394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587160.422979:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127583232:0@lo:400:kworker.0 00000100:00100000:0.0:1788587160.422998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875469127583744:0@lo:400:kworker.0 00000100:00100000:0.0:1788587160.423010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875469127583360:0@lo:400:kworker.0 00010000:00080000:0.0:1788587160.423023:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5a83de0700 x1875469127583872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587160.423035:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83de0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875469127583872:0@lo:400:kworker.0 00010000:00010000:2.0:1788587160.981046:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587161.034853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.034968:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732800 00000100:00100000:0.0:1788587161.034978:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732800 00000100:00100000:0.0:1788587161.035056:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:0.0:1788587161.035067:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+6:15574:x1875469110732800:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587161.035087:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.035110:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdaf46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c8f expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035175:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035189:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035214:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035230:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035237:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035244:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035342:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffe00/0xfbc93bbea5fdaf5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035350:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffe00/0xfbc93bbea5fdaf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035357:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffe00/0xfbc93bbea5fdaf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.035387:0:19333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788587161.035391:0:19333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587161.035458:0:19333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffe00/0xfbc93bbea5fdaf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035469:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035475:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035492:0:19333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035498:0:19333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21fe600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587161.035503:0:19333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035511:0:19333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035522:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:0.0:1788587161.035525:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.035530:0:19333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035536:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035551:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035558:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035564:0:19333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035569:0:19333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21fe200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587161.035572:0:19333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035588:0:19333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035596:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f5b90ec9500) 00010000:00010000:0.0:1788587161.035599:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.035602:0:19333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035608:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035640:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdaf46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c8f expref: 8 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035654:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffe00/0xfbc93bbea5fdaf5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c8f expref: 7 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.035662:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f5b90ec9000) 00010000:00010000:0.0:1788587161.035664:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587161.035666:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc21ffe00, rc 0) 00000100:00100000:0.0:1788587161.035730:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+7:15574:x1875469110732800:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 665us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.035737:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00080000:3.0:1788587161.035802:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587161.041773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587161.042458:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110732928 00000100:00100000:3.0:1788587161.042468:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110732928 00000100:00100000:3.0:1788587161.042531:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:3.0:1788587161.042542:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:15574:x1875469110732928:12345-192.168.203.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587161.042628:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:15574:x1875469110732928:12345-192.168.203.1@tcp:900:lhsmtool_posix.0 Request processed in 88us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.042636:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:1.0:1788587161.045231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587161.045364:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110733184 00000100:00100000:3.0:1788587161.045375:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110733184 00000100:00100000:3.0:1788587161.045492:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:3.0:1788587161.045504:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+7:15574:x1875469110733184:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587161.045528:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587161.045566:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fdaf62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c96 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045643:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045658:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045670:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045684:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045691:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045697:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045800:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7e00/0xfbc93bbea5fdaf77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045808:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7e00/0xfbc93bbea5fdaf77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.045815:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7e00/0xfbc93bbea5fdaf77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587161.045824:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788587161.046079:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046098:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046110:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046116:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587161.046120:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046128:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046139:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f5b90ec9000) 00010000:00010000:3.0:1788587161.046142:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587161.046147:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046153:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70000/0xfbc93bbea5fdaf69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046168:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046174:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046180:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046186:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bbfa70e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587161.046195:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046202:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046210:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f5a834c0900) 00010000:00010000:3.0:1788587161.046213:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587161.046216:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.046222:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70e00/0xfbc93bbea5fdaf70 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.049009:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bbfa70800/0xfbc93bbea5fdaf62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c96 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.049038:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7e00/0xfbc93bbea5fdaf77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c96 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.049048:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5a834c0100) 00010000:00010000:3.0:1788587161.049051:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587161.049054:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa7e00, rc 0) 00000100:00100000:3.0:1788587161.049142:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15574:x1875469110733184:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 3640us (3919us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788587161.049151:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:1.0:1788587161.053516:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.053645:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110733312 00000100:00100000:2.0:1788587161.053656:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110733312 00000100:00100000:2.0:1788587161.053716:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:2.0:1788587161.053727:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15574:x1875469110733312:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788587161.053849:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15574:x1875469110733312:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587161.053858:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:1.0:1788587161.055670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.056633:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110733440 00000100:00100000:0.0:1788587161.056646:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110733440 00000100:00100000:0.0:1788587161.056733:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:0.0:1788587161.056744:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:15574:x1875469110733440:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788587161.058455:0:19333:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1632us 00000100:00080000:3.0:1788587161.059512:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587161.090304:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:15574:x1875469110733440:12345-192.168.203.1@tcp:59:lhsmtool_posix.0 Request processed in 33552us (34630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.090319:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:3.0:1788587161.128724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.128860:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110733568 00000100:00100000:0.0:1788587161.128870:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110733568 00000100:00100000:0.0:1788587161.128935:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:0.0:1788587161.128947:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15580:x1875469110733568:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:0.0:1788587161.128966:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.129000:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810c9d expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129074:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129090:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129103:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129118:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129125:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129131:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129166:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129173:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129192:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129198:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21fe600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587161.129203:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129213:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129225:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:0.0:1788587161.129228:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.129233:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129240:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdaf8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129256:0:17193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129592:0:17193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129599:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129605:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21ffa00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587161.129609:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129626:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129635:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f5b90ec9500) 00010000:00010000:0.0:1788587161.129638:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.129641:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129646:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaf93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129682:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c9d expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129692:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:0.0:1788587161.129695:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.129699:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdaf85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c9d expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.129709:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc21fe200, rc 0) 00000100:00100000:0.0:1788587161.129761:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15580:x1875469110733568:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 816us (1047us total) trans 0 rc 301/301 00000100:00100000:0.0:1788587161.129768:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 27 00000100:00100000:2.0:1788587161.134529:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.136942:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110733696 00000100:00100000:0.0:1788587161.136959:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110733696 00000100:00100000:0.0:1788587161.137025:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:0.0:1788587161.137037:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15580:x1875469110733696:12345-192.168.203.1@tcp:700:lfs.0 00000100:00100000:0.0:1788587161.137160:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15580:x1875469110733696:12345-192.168.203.1@tcp:700:lfs.0 Request processed in 124us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.137168:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:1.0:1788587161.142299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587161.142408:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110733952 00000100:00100000:3.0:1788587161.142439:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110733952 00000100:00100000:3.0:1788587161.142548:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:3.0:1788587161.142560:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+9:15580:x1875469110733952:12345-192.168.203.1@tcp:36:lfs.0 00010000:00010000:3.0:1788587161.142617:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587161.142643:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdaeb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c0a expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.142688:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:3.0:1788587161.142693:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587161.142755:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.142769:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 5 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.142779:0:17192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.142813:0:17192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 5 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.142828:0:17192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 5 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587161.142841:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83755180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1875469127584128:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587161.142933:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587161.146099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.146179:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110734080 00000100:00100000:2.0:1788587161.146189:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110734080 00010000:00010000:2.0:1788587161.146246:0:19528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 6 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587161.146246:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587161.146284:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:2.0:1788587161.146293:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2409:x1875469110734080:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587161.146317:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587161.146324:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 6 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.146349:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 6 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.146371:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:2.0:1788587161.146376:0:19528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.146385:0:19528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.146392:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.146410:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587161.146506:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:2409:x1875469110734080:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 213us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587161.146513:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00010000:00010000:3.0:1788587161.146659:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdaef2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810c7a expref: 5 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587161.146727:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83755180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1875469127584128:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587161.146750:0:17192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.146759:0:17192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.146765:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.146788:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.146798:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.146807:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150032:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150054:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150065:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587161.150093:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035ab62c8 reply state 0000000035193a28 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150105:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150112:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:2.0:1788587161.150114:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587161.150118:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788587161.150124:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788587161.150132:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150138:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150145:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150151:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6e00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587161.150155:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150163:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150174:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5a83481b00) 00010000:00010000:2.0:1788587161.150176:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587161.150180:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150197:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6e00/0xfbc93bbea5fdaf9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587161.150216:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035ab62c8 reply state 0000000035193a28 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150225:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.150232:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f5a834c0900) 00010000:00010000:2.0:1788587161.150234:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587161.150236:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788587161.150390:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+10:15580:x1875469110733952:12345-192.168.203.1@tcp:36:lfs.0 Request processed in 7829us (8098us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788587161.150400:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:1.0:1788587161.291584:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.291830:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110734208 00000100:00100000:0.0:1788587161.291842:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110734208 00000100:00100000:0.0:1788587161.291908:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:0.0:1788587161.291919:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+10:15588:x1875469110734208:12345-192.168.203.1@tcp:101:lctl.0 00010000:00010000:0.0:1788587161.291942:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.291966:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdafaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ca4 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.292045:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdafb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.292061:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdafb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.292073:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdafb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.292122:0:19333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788587161.292126:0:19333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587161.292165:0:19333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdafb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.292189:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdafaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ca4 expref: 12 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.292226:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe600/0xfbc93bbea5fdafb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ca4 expref: 11 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.292234:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:0.0:1788587161.292236:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587161.292240:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc21fe600, rc 0) 00000100:00100000:0.0:1788587161.292316:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8452b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+11:15588:x1875469110734208:12345-192.168.203.1@tcp:101:lctl.0 Request processed in 398us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.292323:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:1.0:1788587161.344261:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.344456:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110734336 00000100:00100000:2.0:1788587161.344465:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110734336 00000100:00100000:2.0:1788587161.344521:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:2.0:1788587161.344531:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:15589:x1875469110734336:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587161.344550:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587161.344568:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdafbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cab expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.344625:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fdafc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.344638:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fdafc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.344664:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fdafc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587161.344705:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788587161.344708:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587161.344727:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fdafc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.344751:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdafbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cab expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.344769:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050800/0xfbc93bbea5fdafc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cab expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.344778:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:2.0:1788587161.344780:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587161.344785:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050800, rc 0) 00000100:00100000:2.0:1788587161.344845:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15589:x1875469110734336:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 314us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587161.344852:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 30 00000040:00080000:2.0:1788587161.366713:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587161.369907:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.370016:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110734464 00000100:00100000:1.0:1788587161.370026:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110734464 00000100:00100000:1.0:1788587161.370086:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:1.0:1788587161.370097:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+6:15589:x1875469110734464:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587161.370116:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587161.370135:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224de00/0xfbc93bbea5fdafcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cb2 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370195:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370222:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370233:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370258:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370272:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370280:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370366:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d000/0xfbc93bbea5fdafe0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370374:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d000/0xfbc93bbea5fdafe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370380:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d000/0xfbc93bbea5fdafe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587161.370460:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788587161.370464:0:17192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587161.370488:0:17192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d000/0xfbc93bbea5fdafe0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370501:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370517:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370524:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370529:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587161.370533:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370540:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370551:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:1.0:1788587161.370554:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587161.370560:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370566:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdafd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370579:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370585:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370591:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370596:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224da00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587161.370605:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370613:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370620:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f5a834c0900) 00010000:00010000:1.0:1788587161.370622:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587161.370626:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370632:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdafd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370657:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224de00/0xfbc93bbea5fdafcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cb2 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370670:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d000/0xfbc93bbea5fdafe0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cb2 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.370678:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:1.0:1788587161.370680:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587161.370683:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224d000, rc 0) 00000100:00100000:1.0:1788587161.371115:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+7:15589:x1875469110734464:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1017us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.371123:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 31 00000100:00100000:3.0:1788587161.386518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.386660:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110734592 00000100:00100000:1.0:1788587161.386670:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110734592 00000100:00080000:0.0:1788587161.386737:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587161.386754:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:1.0:1788587161.386765:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:15589:x1875469110734592:12345-192.168.203.1@tcp:900:lfs.0 00000100:00100000:1.0:1788587161.386865:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:15589:x1875469110734592:12345-192.168.203.1@tcp:900:lfs.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.386872:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:2.0:1788587161.392221:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587161.392299:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110734848 00000100:00100000:3.0:1788587161.392309:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110734848 00000100:00100000:3.0:1788587161.392375:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:3.0:1788587161.392384:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+7:15589:x1875469110734848:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587161.392404:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587161.392458:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdafe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cb9 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587161.392575:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788587161.392675:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdafe7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cb9 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.392690:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:3.0:1788587161.392693:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587161.392699:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdafe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cb9 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.392716:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6a00, rc 0) 00000100:00100000:3.0:1788587161.392781:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+8:15589:x1875469110734848:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 399us (569us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788587161.392788:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 32 00000100:00100000:2.0:1788587161.395873:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.395964:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110735104 00000100:00100000:0.0:1788587161.395974:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110735104 00000100:00100000:0.0:1788587161.396040:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:0.0:1788587161.396051:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18de1d7d-8b16-47d2-9585-abe7106da5ca+8:15589:x1875469110735104:12345-192.168.203.1@tcp:36:lfs.0 00010000:00010000:0.0:1788587161.396105:0:20330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587161.396135:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d000/0xfbc93bbea5fdafe0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cb2 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.396155:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:0.0:1788587161.396160:0:20330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587161.396181:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.396193:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.396202:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587161.396488:0:20330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d041e63 reply state 000000004a3b0c23 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.396500:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.396507:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:0.0:1788587161.396509:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788587161.396512:0:20330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788587161.396519:0:20330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788587161.396597:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:18de1d7d-8b16-47d2-9585-abe7106da5ca+9:15589:x1875469110735104:12345-192.168.203.1@tcp:36:lfs.0 Request processed in 547us (733us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788587161.396604:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 33 00000100:00100000:1.0:1788587161.400597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587161.400867:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110735360 00000100:00100000:3.0:1788587161.400878:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110735360 00000100:00100000:3.0:1788587161.401025:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:3.0:1788587161.401037:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+9:15589:x1875469110735360:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:3.0:1788587161.401299:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+10:15589:x1875469110735360:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 263us (710us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788587161.401307:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:2.0:1788587161.406263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.406381:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110735616 00000100:00100000:1.0:1788587161.406391:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110735616 00000100:00100000:1.0:1788587161.406494:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:1.0:1788587161.406505:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+10:15589:x1875469110735616:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587161.406527:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587161.406546:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdaffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cc0 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406611:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406626:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406636:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406656:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406663:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406669:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587161.406776:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788587161.406846:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406855:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406862:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406868:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587161.406873:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406880:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406901:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:1.0:1788587161.406904:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587161.406909:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406916:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406928:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406934:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406949:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406954:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224ce00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587161.406956:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406963:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406972:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f5a834c0900) 00010000:00010000:1.0:1788587161.406974:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587161.406977:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.406983:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224ce00/0xfbc93bbea5fdb00a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.407235:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdaffc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc0 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.407246:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:1.0:1788587161.407249:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587161.407252:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdaffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc0 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.407263:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224da00, rc 0) 00000100:00100000:1.0:1788587161.407338:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+11:15589:x1875469110735616:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 826us (1075us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788587161.407354:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:2.0:1788587161.409478:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.409571:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110735744 00000100:00100000:1.0:1788587161.409580:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110735744 00000100:00100000:1.0:1788587161.409625:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:1.0:1788587161.409634:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+11:15589:x1875469110735744:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:1.0:1788587161.409844:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587161.409866:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d200/0xfbc93bbea5fdb018 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cc7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.410086:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.410100:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.410111:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587161.412277:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788587161.412286:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587161.412322:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.412376:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d200/0xfbc93bbea5fdb018 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.412397:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.412465:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:1.0:1788587161.412468:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587161.412472:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224c800, rc 0) 00000100:00100000:1.0:1788587161.412557:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+12:15589:x1875469110735744:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 2922us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.412567:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:2.0:1788587161.418852:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.418949:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110735872 00000100:00100000:0.0:1788587161.418960:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110735872 00000100:00100000:0.0:1788587161.419035:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 3 00000100:00100000:0.0:1788587161.419045:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+12:15589:x1875469110735872:12345-192.168.203.1@tcp:37:lfs.0 00000100:00100000:0.0:1788587161.426944:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+12:15589:x1875469110735872:12345-192.168.203.1@tcp:37:lfs.0 Request processed in 7890us (8090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.426958:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 3 00000040:00080000:0.0:1788587161.429990:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587161.437566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587161.437655:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110736128 00000100:00100000:3.0:1788587161.437665:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110736128 00000100:00100000:3.0:1788587161.437723:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:3.0:1788587161.437742:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5baf150450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+12:15589:x1875469110736128:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:3.0:1788587161.437956:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5baf150450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18de1d7d-8b16-47d2-9585-abe7106da5ca+13:15589:x1875469110736128:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 223us (411us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788587161.437970:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 4 00000100:00100000:2.0:1788587161.494070:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.494156:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110736256 00000100:00100000:0.0:1788587161.494166:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110736256 00000100:00100000:0.0:1788587161.494217:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:0.0:1788587161.494226:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+11:15595:x1875469110736256:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:0.0:1788587161.494250:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587161.494269:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cce expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494353:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494366:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494378:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494387:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494394:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494400:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494515:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdb03b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494524:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdb03b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494530:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdb03b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587161.494560:0:19333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788587161.494564:0:19333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587161.494597:0:19333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdb03b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494619:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494625:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494632:0:19333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494638:0:19333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21fec00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587161.494642:0:19333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494649:0:19333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494660:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:0.0:1788587161.494663:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.494667:0:19333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494673:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494686:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494693:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494698:0:19333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494706:0:19333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21ff800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587161.494710:0:19333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494716:0:19333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494722:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f5a834c0900) 00010000:00010000:0.0:1788587161.494724:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587161.494727:0:19333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494938:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb034 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494968:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cce expref: 13 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494981:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe200/0xfbc93bbea5fdb03b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cce expref: 12 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587161.494988:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:0.0:1788587161.494990:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587161.494993:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc21fe200, rc 0) 00000100:00100000:0.0:1788587161.495052:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+12:15595:x1875469110736256:12345-192.168.203.1@tcp:101:bash.0 Request processed in 827us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.495059:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:2.0:1788587161.498192:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.498278:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110736384 00000100:00100000:0.0:1788587161.498302:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110736384 00000100:00100000:0.0:1788587161.498365:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:0.0:1788587161.498375:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cea8b0dc-76f5-470d-a41c-45365485d47c+5:15595:x1875469110736384:12345-192.168.203.1@tcp:900:bash.0 00000100:00100000:0.0:1788587161.498660:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cea8b0dc-76f5-470d-a41c-45365485d47c+5:15595:x1875469110736384:12345-192.168.203.1@tcp:900:bash.0 Request processed in 287us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.498666:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:2.0:1788587161.500983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.501323:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110736640 00000100:00100000:1.0:1788587161.501390:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110736640 00000100:00100000:1.0:1788587161.501516:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 37 00000100:00100000:1.0:1788587161.501527:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+12:15595:x1875469110736640:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:1.0:1788587161.501547:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587161.501566:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d200/0xfbc93bbea5fdb042 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cd5 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.501671:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.501687:0:17192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.501696:0:17192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.501732:0:17192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.501746:0:17192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 12 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587161.501772:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbcb01880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1875469127584256:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788587161.501867:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b90eef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587161.507527:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbcb01880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17192:1875469127584256:192.168.203.1@tcp:104: 00010000:00010000:1.0:1788587161.507559:0:17192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587161.510411:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.511012:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110736768 00000100:00100000:1.0:1788587161.511023:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110736768 00010000:00010000:1.0:1788587161.511071:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 13 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587161.511116:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:1.0:1788587161.511127:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+13:2408:x1875469110736768:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587161.511141:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587161.511147:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 13 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.511160:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 13 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.511182:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c800/0xfbc93bbea5fdb01f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cc7 expref: 13 pid: 17191 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.511198:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:1.0:1788587161.511202:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.511225:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.511233:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.511263:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587161.511306:0:17192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511315:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587161.511322:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+12:2408:x1875469110736768:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 197us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.511338:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00010000:00010000:2.0:1788587161.511346:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511356:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511364:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511871:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511883:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511889:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587161.511899:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587161.511926:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511932:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511946:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511951:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224da00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587161.511956:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511963:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511974:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:2.0:1788587161.511976:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587161.511979:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.511985:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224da00/0xfbc93bbea5fdb049 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587161.512006:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c61b305f reply state 0000000075f2fd5b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.512017:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.512022:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f5b8399a800) 00010000:00010000:2.0:1788587161.512025:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587161.512027:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788587161.512061:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d200/0xfbc93bbea5fdb042 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 15 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.512076:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.512089:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788587161.512091:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788587161.512094:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050000, rc 0) 00000100:00100000:2.0:1788587161.512130:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+15:15595:x1875469110736640:12345-192.168.203.1@tcp:101:bash.0 Request processed in 10606us (11154us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788587161.512138:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 37 00000100:00100000:1.0:1788587161.533526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.533842:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110736896 00000100:00100000:2.0:1788587161.533852:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110736896 00000100:00100000:2.0:1788587161.533914:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:2.0:1788587161.533925:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+15:15595:x1875469110736896:12345-192.168.203.1@tcp:101:bash.0 00010000:00010000:2.0:1788587161.533948:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587161.533968:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb065 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cdc expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534037:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534051:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534063:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587161.534109:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788587161.534113:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587161.534131:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534160:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534187:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb065 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534206:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 16 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.534215:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788587161.534218:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587161.534221:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051c00, rc 0) 00000100:00100000:2.0:1788587161.534274:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+16:15595:x1875469110736896:12345-192.168.203.1@tcp:101:bash.0 Request processed in 350us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587161.534281:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 38 00000100:00100000:3.0:1788587161.540185:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.540299:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110737152 00000100:00100000:0.0:1788587161.540309:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110737152 00000100:00100000:0.0:1788587161.540377:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:0.0:1788587161.540388:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+16:15595:x1875469110737152:12345-192.168.203.1@tcp:35:bash.0 00000100:00100000:0.0:1788587161.540713:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+17:15595:x1875469110737152:12345-192.168.203.1@tcp:35:bash.0 Request processed in 327us (538us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788587161.540721:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 5 00000100:00100000:0.0:1788587161.644839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.645064:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110737408 00000100:00100000:2.0:1788587161.645076:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110737408 00000100:00100000:2.0:1788587161.645142:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:2.0:1788587161.645152:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+17:15605:x1875469110737408:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:2.0:1788587161.645177:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587161.645198:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb073 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810ce3 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587161.645739:0:19333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788587161.645834:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb073 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ce3 expref: 19 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.646547:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f5b90ec9500) 00010000:00010000:2.0:1788587161.646550:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587161.646558:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810ce3 expref: 19 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587161.646573:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050200, rc 0) 00000100:00100000:3.0:1788587161.647123:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+18:15605:x1875469110737408:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 1969us (2289us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788587161.647133:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 39 00000100:00100000:1.0:1788587161.653702:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.653934:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110737664 00000100:00100000:0.0:1788587161.653944:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110737664 00000100:00100000:0.0:1788587161.654129:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:0.0:1788587161.654140:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+18:15605:x1875469110737664:12345-192.168.203.1@tcp:35:lfs.0 00000100:00100000:0.0:1788587161.654372:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+19:15605:x1875469110737664:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 234us (679us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788587161.654379:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 6 00000100:00100000:2.0:1788587161.707366:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.707476:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.707511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.707530:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.707552:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.707574:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.707591:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738304 00000100:00100000:0.0:1788587161.707601:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738304 00000100:00100000:0.0:1788587161.707664:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738560 00000100:00100000:0.0:1788587161.707667:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738560 00000100:00100000:0.0:1788587161.707682:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738176 00000100:00100000:0.0:1788587161.707685:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738176 00000100:00100000:0.0:1788587161.707715:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738432 00000100:00100000:0.0:1788587161.707718:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738432 00000100:00100000:0.0:1788587161.707735:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:3.0:1788587161.707744:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738048 00000100:00100000:0.0:1788587161.707744:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2407:x1875469110738304:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587161.707748:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738048 00000100:00100000:3.0:1788587161.707774:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 165 00000100:00100000:3.0:1788587161.707780:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+13:2407:x1875469110738048:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1788587161.707937:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2407:x1875469110738304:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.707946:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 14 00000100:00100000:0.0:1788587161.707963:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:0.0:1788587161.707970:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2407:x1875469110738560:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587161.708374:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38609982-39d4-4f97-a9ad-eea20d935b3f+13:2407:x1875469110738048:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 591us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.708382:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 165 00000100:00100000:3.0:1788587161.708567:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788587161.708577:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2407:x1875469110738176:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587161.708607:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2407:x1875469110738176:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 33us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.708614:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 16 00000100:00100000:3.0:1788587161.708628:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:3.0:1788587161.708635:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2407:x1875469110738432:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1788587161.708658:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2407:x1875469110738432:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 24us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.708664:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:3.0:1788587161.708709:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110737920 00000100:00100000:3.0:1788587161.708723:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110737920 00000100:00100000:3.0:1788587161.708759:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00100000:3.0:1788587161.708767:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+19:15608:x1875469110737920:12345-192.168.203.1@tcp:101:lfs.0 00010000:00010000:3.0:1788587161.708784:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587161.708807:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb081 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cea expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.709111:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb088 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.709126:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.709137:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb088 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587161.709148:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788587161.709338:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb081 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cea expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.709357:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb088 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cea expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.709365:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587161.709368:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587161.709371:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6200, rc 0) 00000100:00100000:3.0:1788587161.709398:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15608:x1875469110737920:12345-192.168.203.1@tcp:101:lfs.0 Request processed in 634us (2044us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788587161.709404:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 40 00000100:00080000:2.0:1788587161.709707:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587161.709712:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587161.713582:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18de1d7d-8b16-47d2-9585-abe7106da5ca+5:2407:x1875469110738560:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 5599us (6037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587161.713597:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 15 00000100:00100000:2.0:1788587161.715637:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587161.715783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587161.716106:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738816 00000100:00100000:1.0:1788587161.716117:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738816 00000100:00100000:1.0:1788587161.716177:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:1.0:1788587161.716187:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15608:x1875469110738816:12345-192.168.203.1@tcp:54:lfs.0 00010000:00010000:1.0:1788587161.716263:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716279:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716300:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716350:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716357:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716376:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716382:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c000 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587161.716385:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716393:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716404:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:1.0:1788587161.716407:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587161.716411:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587161.716446:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c000/0xfbc93bbea5fdb096 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587161.716528:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15608:x1875469110738816:12345-192.168.203.1@tcp:54:lfs.0 Request processed in 338us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587161.716536:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 41 00000100:00100000:3.0:1788587161.718574:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110738688 00000100:00100000:3.0:1788587161.718587:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110738688 00000100:00100000:3.0:1788587161.718645:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:3.0:1788587161.718655:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+21:2406:x1875469110738688:12345-192.168.203.1@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788587161.718857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587161.718886:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110739072 00000100:00100000:0.0:1788587161.718891:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110739072 00010000:00010000:3.0:1788587161.718924:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788587161.718929:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:0.0:1788587161.718935:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+22:15608:x1875469110739072:12345-192.168.203.1@tcp:35:lfs.0 00010000:00010000:3.0:1788587161.718947:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb088 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cea expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587161.718965:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587161.718970:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587161.719156:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+22:2406:x1875469110738688:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 501us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587161.719164:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:1.0:1788587161.721378:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15608:x1875469110739072:12345-192.168.203.1@tcp:35:lfs.0 Request processed in 2335us (2414us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788587161.721397:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 7 00000100:00100000:2.0:1788587162.002581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.003506:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110739328 00000100:00100000:3.0:1788587162.003517:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110739328 00000100:00100000:3.0:1788587162.003575:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 42 00000100:00100000:3.0:1788587162.003586:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15639:x1875469110739328:12345-192.168.203.1@tcp:101:cat.0 00010000:00010000:3.0:1788587162.003610:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587162.003631:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb09d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cf1 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.003745:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb0a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.003761:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.003773:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587162.003800:0:19333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788587162.003931:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb09d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cf1 expref: 24 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.003950:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cf1 expref: 23 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.003959:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587162.003961:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587162.003964:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6a00, rc 0) 00000100:00100000:3.0:1788587162.004037:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+23:15639:x1875469110739328:12345-192.168.203.1@tcp:101:cat.0 Request processed in 453us (1464us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788587162.004043:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 42 00010000:00010000:2.0:1788587162.004916:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587162.008644:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.008707:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.008856:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110739712 00000100:00100000:0.0:1788587162.008866:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110739712 00000100:00100000:0.0:1788587162.008932:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:0.0:1788587162.008944:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+23:2408:x1875469110739712:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587162.008961:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587162.008986:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6a00/0xfbc93bbea5fdb0a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cf1 expref: 23 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.009005:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788587162.009017:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587162.009273:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+22:2408:x1875469110739712:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 323us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.009282:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:1.0:1788587162.010901:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110739584 00000100:00100000:1.0:1788587162.010914:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110739584 00000100:00100000:1.0:1788587162.010964:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:1.0:1788587162.010972:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+22:15639:x1875469110739584:12345-192.168.203.1@tcp:35:cat.0 00000100:00100000:1.0:1788587162.011617:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb05af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+23:15639:x1875469110739584:12345-192.168.203.1@tcp:35:cat.0 Request processed in 642us (2979us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788587162.011626:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 8 00000100:00100000:2.0:1788587162.071131:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.071652:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110739968 00000100:00100000:3.0:1788587162.071664:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110739968 00000100:00100000:3.0:1788587162.071740:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:3.0:1788587162.071751:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+23:15645:x1875469110739968:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:3.0:1788587162.071775:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587162.071804:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb0b2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cf8 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.071929:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.071944:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.071971:0:17193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.071979:0:17193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.072014:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.072027:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.072041:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83754000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1875469127584384:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587162.072143:0:17193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.072153:0:17193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 24 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.072162:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83754a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1875469127584512:192.168.203.1@tcp:104: 00000100:00100000:3.0:1788587162.072185:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5bafb9e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587162.082689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.082736:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83754a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1875469127584512:192.168.203.1@tcp:104: 00000100:00100000:1.0:1788587162.087387:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110740096 00000100:00100000:1.0:1788587162.087404:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110740096 00010000:00010000:0.0:1788587162.087582:0:19528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 25 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.087625:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:0.0:1788587162.087634:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+25:2408:x1875469110740096:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587162.087648:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587162.087655:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 25 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.087667:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 25 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.087689:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb057 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cd5 expref: 25 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.087715:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788587162.087721:0:19528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.087730:0:19528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.087736:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587162.087809:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+24:2408:x1875469110740096:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 176us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.087817:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 17 00000100:00100000:0.0:1788587162.088640:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83754000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17193:1875469127584384:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587162.088667:0:17193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.089102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.089186:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110740224 00000100:00100000:1.0:1788587162.089194:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110740224 00010000:00010000:1.0:1788587162.089224:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587162.089261:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 18 00000100:00100000:1.0:1788587162.089271:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb5b54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+24:2409:x1875469110740224:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587162.089285:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587162.089291:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.089302:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.089320:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051c00/0xfbc93bbea5fdb06c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cdc expref: 24 pid: 17191 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.089353:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:1.0:1788587162.089358:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.089367:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.089386:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.089813:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587162.089874:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb5b54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+23:2409:x1875469110740224:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 603us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.089882:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 18 00010000:00010000:2.0:1788587162.093240:0:17193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.093258:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587162.093303:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587162.093525:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6200/0xfbc93bbea5fdb0b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cf8 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.093546:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6400/0xfbc93bbea5fdb0b9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cf8 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.093556:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788587162.093558:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587162.093562:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6400, rc 0) 00000100:00100000:2.0:1788587162.093622:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+23:15645:x1875469110739968:12345-192.168.203.1@tcp:101:dd.0 Request processed in 21872us (22500us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788587162.093631:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 43 00000100:00100000:2.0:1788587162.098193:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.098466:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110740352 00000100:00100000:0.0:1788587162.098476:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110740352 00000100:00100000:0.0:1788587162.098546:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:0.0:1788587162.098556:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+23:15645:x1875469110740352:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:0.0:1788587162.098580:0:20330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.098602:0:20330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810cff expref: -99 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.098638:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.098652:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.098663:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.098990:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 25 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.099011:0:20330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 24 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.099031:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788587162.099034:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587162.099037:0:20330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc21ff800, rc 0) 00000100:00100000:0.0:1788587162.099133:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+24:15645:x1875469110740352:12345-192.168.203.1@tcp:101:dd.0 Request processed in 578us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.099141:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 44 00000100:00100000:3.0:1788587162.103363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.104631:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110740608 00000100:00100000:0.0:1788587162.104644:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110740608 00000100:00100000:0.0:1788587162.104702:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 45 00000100:00100000:0.0:1788587162.104724:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+24:15645:x1875469110740608:12345-192.168.203.1@tcp:36:dd.0 00010000:00010000:0.0:1788587162.104940:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.104958:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.104971:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587162.105019:0:17192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788587162.105043:0:17192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c7f2416 reply state 00000000bbe72c84 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.105056:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.105065:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788587162.105068:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587162.105085:0:17192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587162.105186:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+27:15645:x1875469110740608:12345-192.168.203.1@tcp:36:dd.0 Request processed in 464us (1831us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788587162.105194:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 45 00000020:00080000:0.0:1788587162.105199:0:17192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788587162.109154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.109315:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110740736 00000100:00100000:2.0:1788587162.109334:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110740736 00000100:00100000:2.0:1788587162.109394:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:2.0:1788587162.109403:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+27:15645:x1875469110740736:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:2.0:1788587162.109469:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.109491:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb0dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d06 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.109547:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb0dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d06 expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.109563:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb0dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d06 expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.109606:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788587162.109610:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587162.109614:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050000, rc 0) 00000100:00100000:2.0:1788587162.109676:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15645:x1875469110740736:12345-192.168.203.1@tcp:101:dd.0 Request processed in 274us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.109683:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 46 00000100:00100000:2.0:1788587162.155518:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.155702:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110740992 00000100:00100000:0.0:1788587162.155712:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110740992 00000100:00100000:0.0:1788587162.155793:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:0.0:1788587162.155804:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15645:x1875469110740992:12345-192.168.203.1@tcp:103:dd.0 00010000:00010000:0.0:1788587162.155818:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587162.156048:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb0dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d06 expref: 28 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.156068:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788587162.156083:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587162.156140:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+27:15645:x1875469110740992:12345-192.168.203.1@tcp:103:dd.0 Request processed in 339us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.156148:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 2 00000100:00100000:1.0:1788587162.170108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.170277:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110741120 00000100:00100000:0.0:1788587162.170288:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110741120 00000100:00100000:0.0:1788587162.170365:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:0.0:1788587162.170375:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+27:15645:x1875469110741120:12345-192.168.203.1@tcp:58:dd.0 00010000:00010000:0.0:1788587162.170507:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.170525:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.170537:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587162.174121:0:20330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587162.174151:0:20330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788587162.174376:0:20330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788587162.174614:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+27:15645:x1875469110741120:12345-192.168.203.1@tcp:58:dd.0 Request processed in 4236us (4513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.174625:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 47 00000100:00100000:3.0:1788587162.183714:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.183994:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110741248 00000100:00100000:1.0:1788587162.184004:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110741248 00000100:00100000:1.0:1788587162.184066:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 48 00000100:00100000:1.0:1788587162.184199:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+27:15645:x1875469110741248:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:1.0:1788587162.184221:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587162.184306:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d0d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.184528:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.184541:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 28 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.184560:0:17191:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.184573:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 28 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.184599:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:1.0:1788587162.184602:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587162.184606:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 28 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.184614:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224dc00, rc 0) 00000100:00100000:1.0:1788587162.184728:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15645:x1875469110741248:12345-192.168.203.1@tcp:101:dd.0 Request processed in 534us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.184735:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 48 00000040:00080000:2.0:1788587162.389923:0:17226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788587162.389934:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587162.390003:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788587162.390013:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788587162.390561:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17226:1875469127584640:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587162.390737:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83418600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587162.398668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.398996:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110741376 00000100:00100000:0.0:1788587162.399007:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110741376 00000100:00100000:0.0:1788587162.399070:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:0.0:1788587162.399081:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+29:15646:x1875469110741376:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587162.399111:0:19333:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587162.400052:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17226:1875469127584640:192.168.203.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587162.400931:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15646:x1875469110741376:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 1847us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.400943:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 49 00000100:00100000:0.0:1788587162.411056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.411191:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110741504 00000100:00100000:1.0:1788587162.411201:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110741504 00000100:00100000:1.0:1788587162.411269:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:1.0:1788587162.411279:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15646:x1875469110741504:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788587162.411369:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411388:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411405:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411718:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411727:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411763:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411790:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411800:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411816:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587162.411862:0:20330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788587162.411867:0:20330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587162.411883:0:20330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411894:0:20330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411900:0:20330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411908:0:20330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411914:0:20330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587162.411919:0:20330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411928:0:20330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411948:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5a834c0100) 00010000:00010000:1.0:1788587162.411951:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587162.411957:0:20330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411963:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb0f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411974:0:20330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411980:0:20330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411985:0:20330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411990:0:20330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587162.411993:0:20330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.411999:0:20330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412006:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f5a83577a00) 00010000:00010000:1.0:1788587162.412008:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587162.412011:0:20330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412017:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb0f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412043:0:20330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412050:0:20330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412055:0:20330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412060:0:20330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224d800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:1.0:1788587162.412063:0:20330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412069:0:20330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412077:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:1.0:1788587162.412079:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587162.412082:0:20330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.412088:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224d800/0xfbc93bbea5fdb0ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587162.412173:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15646:x1875469110741504:12345-192.168.203.1@tcp:34:lhsmtool_posix.0 Request processed in 893us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.412181:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 50 00000100:00100000:1.0:1788587162.420995:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.421591:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110741760 00000100:00100000:2.0:1788587162.421602:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110741760 00000100:00100000:2.0:1788587162.421669:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:2.0:1788587162.421680:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+28:15646:x1875469110741760:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.421700:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.421721:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb106 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d14 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421825:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421859:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421871:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587162.421884:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587162.421962:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421970:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421977:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421983:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:2.0:1788587162.421987:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.421995:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.422007:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788587162.422010:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587162.422015:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.422022:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb10d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.422067:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb106 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d14 expref: 30 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.422084:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f5a834c0100) 00010000:00010000:2.0:1788587162.422087:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587162.422091:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb106 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d14 expref: 30 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.422101:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2051800, rc 0) 00000100:00100000:2.0:1788587162.422159:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+29:15646:x1875469110741760:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 481us (1173us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788587162.422166:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 51 00000100:00100000:3.0:1788587162.433105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.433210:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110741888 00000100:00100000:0.0:1788587162.433220:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110741888 00000100:00100000:0.0:1788587162.433285:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:0.0:1788587162.433296:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+29:15646:x1875469110741888:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587162.433342:0:19333:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587162.433506:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+29:15646:x1875469110741888:12345-192.168.203.1@tcp:53:lhsmtool_posix.0 Request processed in 210us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.433514:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 52 00000100:00100000:0.0:1788587162.449294:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.449413:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110742144 00000100:00100000:1.0:1788587162.449462:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110742144 00000100:00100000:1.0:1788587162.449541:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:1.0:1788587162.449562:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+29:15646:x1875469110742144:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587162.449585:0:20330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587162.449605:0:20330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb11b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d1b expref: -99 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587162.453580:0:20330:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1788587162.453592:0:20330:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788587162.453612:0:20330:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788587162.453804:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb122 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.453821:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.453832:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb122 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.453901:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb11b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d1b expref: 32 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.453918:0:20330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb122 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d1b expref: 31 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.453928:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5a83577a00) 00010000:00010000:1.0:1788587162.453931:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587162.453935:0:20330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5a8224c600, rc 0) 00000100:00100000:1.0:1788587162.454302:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+31:15646:x1875469110742144:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 4749us (5018us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788587162.454336:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 53 00000100:00100000:1.0:1788587162.473773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.473923:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110742400 00000100:00100000:3.0:1788587162.473934:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110742400 00000100:00100000:3.0:1788587162.473996:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:3.0:1788587162.474005:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+31:15646:x1875469110742400:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587162.474064:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587162.474100:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c600/0xfbc93bbea5fdb122 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d1b expref: 31 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474120:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5a83577a00) 00010000:00010000:3.0:1788587162.474130:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587162.474151:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474164:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474174:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474187:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474194:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474200:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474248:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474270:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474276:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474282:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa6800 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.474299:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474308:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474317:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:3.0:1788587162.474329:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.474335:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474341:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa6800/0xfbc93bbea5fdb130 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474351:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474357:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474364:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474369:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.474378:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474385:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474393:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe449b8c4 (ffff8f5a834c0f00) 00010000:00010000:3.0:1788587162.474396:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.474399:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.474405:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb137 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe449b8c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.474545:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+30:15646:x1875469110742400:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 540us (781us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587162.474553:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 54 00000100:00100000:0.0:1788587162.478487:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.482177:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110742528 00000100:00100000:2.0:1788587162.482198:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110742528 00000100:00100000:2.0:1788587162.482293:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:2.0:1788587162.482306:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+30:15646:x1875469110742528:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.482336:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.482361:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb13e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d22 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.482404:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb145 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.482437:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.482450:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb145 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.482574:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb13e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d22 expref: 32 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.482602:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050200/0xfbc93bbea5fdb145 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d22 expref: 31 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.482611:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:2.0:1788587162.482613:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587162.482616:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050200, rc 0) 00000100:00100000:2.0:1788587162.482687:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+31:15646:x1875469110742528:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 384us (4210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.482695:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 55 00000100:00100000:0.0:1788587162.487130:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.487366:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110742784 00000100:00100000:1.0:1788587162.487375:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110742784 00000100:00100000:1.0:1788587162.487474:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:1.0:1788587162.487484:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+31:15646:x1875469110742784:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587162.487568:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.487586:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.487598:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587162.487765:0:20330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788587162.487797:0:20330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 508418379905ns, next at 509418355797ns, rc = 0 00000004:00010000:1.0:1788587162.487846:0:20330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031d31bde reply state 00000000d05f4e6e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.487859:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.487867:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:1.0:1788587162.487870:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788587162.487873:0:20330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587162.487977:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+33:15646:x1875469110742784:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 493us (856us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788587162.487984:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 56 00000100:00100000:3.0:1788587162.490956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.491057:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110742912 00000100:00100000:0.0:1788587162.491067:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110742912 00000100:00100000:0.0:1788587162.491134:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:0.0:1788587162.491155:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+33:15646:x1875469110742912:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.491180:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.491201:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d29 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.491272:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 34 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.491286:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 34 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.491305:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:0.0:1788587162.491308:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587162.491313:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b829f4c00, rc 0) 00000100:00100000:0.0:1788587162.491386:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+34:15646:x1875469110742912:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 241us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.491393:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 57 00000100:00100000:3.0:1788587162.498090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.498472:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110743040 00000100:00100000:0.0:1788587162.498483:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110743040 00000100:00100000:0.0:1788587162.498544:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:0.0:1788587162.498553:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2409:x1875469110743040:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788587162.498783:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2409:x1875469110743040:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 231us (705us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788587162.498806:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:1.0:1788587162.501484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.501613:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110743296 00000100:00100000:3.0:1788587162.501622:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110743296 00000100:00100000:3.0:1788587162.501672:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:3.0:1788587162.501682:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+34:15646:x1875469110743296:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587162.501930:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+35:15646:x1875469110743296:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 248us (454us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788587162.501939:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 9 00000100:00100000:1.0:1788587162.505529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.505614:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110743552 00000100:00100000:2.0:1788587162.505623:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110743552 00000100:00100000:2.0:1788587162.505681:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:2.0:1788587162.505692:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+35:15646:x1875469110743552:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587162.505817:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+35:15646:x1875469110743552:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 126us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.505826:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 58 00000100:00100000:1.0:1788587162.508612:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.508706:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110743680 00000100:00100000:0.0:1788587162.508717:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110743680 00000100:00100000:0.0:1788587162.508783:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:0.0:1788587162.508795:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+35:15646:x1875469110743680:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.508818:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.508840:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837be200/0xfbc93bbea5fdb15a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d30 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.508927:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837bf800/0xfbc93bbea5fdb161 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.508942:0:19333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837bf800/0xfbc93bbea5fdb161 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.508953:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837bf800/0xfbc93bbea5fdb161 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587162.508998:0:19333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587162.509018:0:19333:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837bf800/0xfbc93bbea5fdb161 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.509042:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837be200/0xfbc93bbea5fdb15a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d30 expref: 37 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.509060:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837bf800/0xfbc93bbea5fdb161 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d30 expref: 36 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.509069:0:19333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:0.0:1788587162.509078:0:19333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587162.509082:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b837bf800, rc 0) 00000100:00100000:0.0:1788587162.509387:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+36:15646:x1875469110743680:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 356us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.509395:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 59 00000100:00100000:0.0:1788587162.513521:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.513694:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110743808 00000100:00100000:3.0:1788587162.513706:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110743808 00000100:00100000:3.0:1788587162.513767:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788587162.513795:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+6:2409:x1875469110743808:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587162.513817:0:19770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587162.513838:0:19770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d37 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587162.513866:0:19770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac9a, blocks: 0x0 00010000:00010000:3.0:1788587162.513887:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=508s v=(0 0) 00010000:00010000:3.0:1788587162.513892:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587162.513902:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 7 pid: 19770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.513921:0:19770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 7 pid: 19770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.513934:0:19770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5ba1aa6800, rc 0) 00000100:00100000:3.0:1788587162.513999:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2409:x1875469110743808:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 207us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.514006:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:1.0:1788587162.521701:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.521909:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744064 00000100:00100000:2.0:1788587162.521919:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744064 00000100:00100000:2.0:1788587162.521979:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:2.0:1788587162.521987:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+36:15646:x1875469110744064:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587162.522099:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+36:15646:x1875469110744064:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 111us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.522106:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 60 00000100:00100000:1.0:1788587162.525662:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.525807:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744192 00000100:00100000:0.0:1788587162.525817:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744192 00000100:00100000:0.0:1788587162.525874:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:0.0:1788587162.525885:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+36:15646:x1875469110744192:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788587162.528227:0:17171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788587162.528253:0:17171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788587162.528314:0:17171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788587162.528551:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587162.528583:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127584768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788587162.528647:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587162.528696:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127584768 00000100:00100000:2.0:1788587162.528705:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127584768 00000100:00100000:2.0:1788587162.528754:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587162.528761:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127584768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788587162.528886:0:18699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788587162.528890:0:18699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788587162.528892:0:18699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587162.528894:0:18699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788587162 -> 1788587162 00002000:00010000:2.0:1788587162.528896:0:18699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788587162.528940:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875469127584768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (293us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788587162.528946:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788587162.528968:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788587162.529011:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f5bbc79ed80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788587162.529017:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127584768:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788587162.529356:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.529367:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.529374:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.529380:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21ffa00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.529393:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.529401:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.529447:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:3.0:1788587162.529451:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788587162.529456:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.529463:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ffa00/0xfbc93bbea5fdaff5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529630:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529638:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529643:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529648:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587162.529651:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529657:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529666:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f5a834c0900) 00010000:00010000:0.0:1788587162.529669:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.529672:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529689:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7a00/0xfbc93bbea5fdafa1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529706:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529711:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529717:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529723:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587162.529726:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529732:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529739:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f5b8399a000) 00010000:00010000:0.0:1788587162.529741:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.529744:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529749:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdafa8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529760:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529767:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529779:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529783:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587162.529786:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529792:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529801:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f5b8399a800) 00010000:00010000:0.0:1788587162.529803:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.529805:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529811:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb050 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529826:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529832:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529836:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529842:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21fec00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587162.529844:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529859:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529866:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:0.0:1788587162.529868:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587162.529871:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529877:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fec00/0xfbc93bbea5fdb0d5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529889:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529895:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529899:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529904:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224c200 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:0.0:1788587162.529906:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529911:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529918:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:0.0:1788587162.529921:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587162.529923:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.529938:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224c200/0xfbc93bbea5fdb14c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.530105:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+15:15646:x1875469110744192:12345-192.168.203.1@tcp:44:lhsmtool_posix.0 Request processed in 4218us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.530114:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 61 00000100:00100000:0.0:1788587162.532898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.532963:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744320 00000100:00100000:3.0:1788587162.532973:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744320 00000100:00100000:3.0:1788587162.533042:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:3.0:1788587162.533053:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2408:x1875469110744320:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788587162.533229:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2408:x1875469110744320:12345-192.168.203.1@tcp:16:lhsmtool_posix.0 Request processed in 177us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.533247:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:3.0:1788587162.536020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.536093:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744576 00000100:00100000:0.0:1788587162.536101:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744576 00000100:00100000:2.0:1788587162.536258:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 62 00000100:00100000:2.0:1788587162.536269:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+15:15646:x1875469110744576:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.536331:0:17193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587162.536360:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b837bf800/0xfbc93bbea5fdb161 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d30 expref: 15 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.536379:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:2.0:1788587162.536384:0:17193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587162.536453:0:17193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb16f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.536482:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb16f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.536497:0:17193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb16f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587162.536615:0:17193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015be75c7 reply state 000000009f4a0624 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb16f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.536627:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051800/0xfbc93bbea5fdb16f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.536632:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:2.0:1788587162.536635:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788587162.536637:0:17193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587162.536724:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+16:15646:x1875469110744576:12345-192.168.203.1@tcp:36:lhsmtool_posix.0 Request processed in 457us (713us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788587162.536732:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 62 00000100:00100000:1.0:1788587162.547000:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.547091:0:19394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744704 00000100:00100000:2.0:1788587162.547101:0:19394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744704 00000100:00100000:0.0:1788587162.547258:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:0.0:1788587162.547271:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+7:15646:x1875469110744704:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.547287:0:18699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587162.547305:0:18699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d3e expref: -99 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.547350:0:18699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.547360:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587162.547364:0:18699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587162.547370:0:18699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 8 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.547405:0:18699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.547486:0:18699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.547501:0:18699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18699:1875469127584896:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587162.547583:0:18699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b87fc26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587162.550549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.550809:0:18699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18699:1875469127584896:192.168.203.1@tcp:104: 00010000:00010000:0.0:1788587162.550844:0:18699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 8 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.550865:0:18699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5b837bec00, rc 0) 00000100:00100000:0.0:1788587162.550923:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+8:15646:x1875469110744704:12345-192.168.203.1@tcp:101:lhsmtool_posix.0 Request processed in 3655us (3931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587162.550931:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:2.0:1788587162.552472:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744832 00000100:00100000:2.0:1788587162.552486:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744832 00010000:00010000:2.0:1788587162.552528:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.552574:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:2.0:1788587162.552583:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+8:2408:x1875469110744832:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587162.552596:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587162.552633:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.552646:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.552668:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c956d62d/0xfbc93bbea5fdb168 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d37 expref: 8 pid: 19770 timeout: 608 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.552685:0:17176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.552689:0:17176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.552695:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 7 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.552705:0:17176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 7 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.552743:0:17176:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 7 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.552758:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17176:1875469127585024:192.168.203.1@tcp:105: 00000100:00100000:2.0:1788587162.552844:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83418840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587162.555879:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17176:1875469127585024:192.168.203.1@tcp:105: 00010000:00010000:2.0:1788587162.555905:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587162.555961:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2408:x1875469110744832:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 3379us (5420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.555988:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 19 00000100:00100000:1.0:1788587162.558388:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.558521:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110744960 00000100:00100000:2.0:1788587162.558531:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110744960 00000100:00100000:2.0:1788587162.558591:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:2.0:1788587162.558601:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5b83793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2408:x1875469110744960:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587162.558750:0:18698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788587162.558753:0:18698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788587162 00002000:00010000:2.0:1788587162.558756:0:18698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788587161 00002000:00010000:2.0:1788587162.558758:0:18698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788587162 -> 1788587162 00002000:00010000:2.0:1788587162.558760:0:18698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788587162.558811:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5b83793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+8:2408:x1875469110744960:12345-192.168.203.1@tcp:2:lhsmtool_posix.0 Request processed in 211us (430us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788587162.558819:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 25 00000100:00100000:1.0:1788587162.561523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1788587162.561643:0:19770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110745088 00000100:00100000:0.0:1788587162.561653:0:19770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110745088 00000100:00100000:0.0:1788587162.561705:0:19770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:0.0:1788587162.561714:0:19770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+8:2409:x1875469110745088:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788587162.561755:0:19770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.561774:0:19770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 8 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.561801:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587162.561806:0:19770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587162.561810:0:19770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.561845:0:19770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 8 pid: 18699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.561859:0:19770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 8 pid: 18699 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.561876:0:19770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19770:1875469127585152:192.168.203.1@tcp:104: 00000100:00100000:0.0:1788587162.561956:0:19770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b87fc26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587162.564842:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.564941:0:19770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19770:1875469127585152:192.168.203.1@tcp:104: 00010000:00010000:3.0:1788587162.564970:0:19770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587162.565088:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110745216 00000100:00100000:1.0:1788587162.565095:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110745216 00010000:00010000:1.0:1788587162.565131:0:19528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 9 pid: 18699 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587162.565178:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 20 00000100:00100000:1.0:1788587162.565188:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+9:2409:x1875469110745216:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587162.565202:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587162.565223:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 9 pid: 18699 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.565235:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 9 pid: 18699 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.565269:0:19528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f92cf7/0xfbc93bbea5fdb176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d3e expref: 9 pid: 18699 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.565297:0:19528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587162.565302:0:19528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587162.565307:0:19528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.565316:0:19528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.565357:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587162.565409:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+8:2409:x1875469110745216:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 221us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.565463:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 20 00010000:00010000:3.0:1788587162.565690:0:19770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565712:0:19770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565732:0:19770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565740:0:19770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565748:0:19770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565755:0:19770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5b837bfe00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:3.0:1788587162.565759:0:19770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565768:0:19770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565781:0:19770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.565789:0:19770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078942b4b/0xfbc93bbea5fdb17d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.565844:0:19770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2409:x1875469110745088:12345-192.168.203.1@tcp:1:lhsmtool_posix.0 Request processed in 4130us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.565852:0:19770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 26 00000100:00100000:1.0:1788587162.568385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.568639:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110745472 00000100:00100000:2.0:1788587162.568650:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110745472 00000100:00100000:2.0:1788587162.568734:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 63 00000100:00100000:2.0:1788587162.568743:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbcb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+16:15646:x1875469110745472:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587162.568818:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.568835:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 16 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.568844:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.568877:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 16 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.568904:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 16 pid: 20330 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.568918:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1875469127585280:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587162.569092:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83418840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587162.572332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.572397:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110745600 00000100:00100000:3.0:1788587162.572406:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110745600 00010000:00010000:3.0:1788587162.572473:0:17178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 17 pid: 20330 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.572511:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 21 00000100:00100000:3.0:1788587162.572520:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+17:2408:x1875469110745600:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587162.572535:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587162.572541:0:17178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 17 pid: 20330 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.572558:0:17178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 17 pid: 20330 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.572584:0:17178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587162.572590:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 17 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.572600:0:17178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.572607:0:17178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.572634:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.572657:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587162.572717:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cea8b0dc-76f5-470d-a41c-45365485d47c+17:2408:x1875469110745600:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 197us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587162.572725:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 21 00010000:00010000:2.0:1788587162.574596:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21ff800/0xfbc93bbea5fdb0ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810cff expref: 16 pid: 20330 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.574621:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1875469127585280:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587162.574646:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574656:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574663:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574877:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574890:0:17191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574899:0:17191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574934:0:17191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.574958:0:17191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 16 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.574974:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1875469127585408:192.168.203.1@tcp:104: 00000100:00100000:2.0:1788587162.575306:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83418b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587162.578135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.578216:0:19528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110745728 00000100:00100000:1.0:1788587162.578227:0:19528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110745728 00010000:00010000:1.0:1788587162.578284:0:19528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 17 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587162.578337:0:19528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:1.0:1788587162.578347:0:19528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+17:2409:x1875469110745728:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587162.578362:0:19528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587162.578369:0:19528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 17 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.578383:0:19528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 17 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.578589:0:19528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:1.0:1788587162.578595:0:19528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.578606:0:19528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.578614:0:19528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.578631:0:19528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587162.578758:0:19528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+17:2409:x1875469110745728:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 411us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.578766:0:19528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00010000:00010000:2.0:1788587162.578842:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5b829f4c00/0xfbc93bbea5fdb153 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d29 expref: 16 pid: 17192 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.578858:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1875469127585408:192.168.203.1@tcp:104: 00010000:00010000:2.0:1788587162.578877:0:17191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.578886:0:17191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.578893:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587162.579055:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788587162.579161:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788587162.579194:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788587162.580111:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1875469127585536:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587162.580167:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587162.580238:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5b83418000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587162.580804:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127585536 00000100:00100000:1.0:1788587162.580813:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127585536 00000100:00100000:1.0:1788587162.580897:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587162.580906:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875469127585536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587162.581164:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17191:x1875469127585536:12345-0@lo:1000:mdt00_000.0 Request processed in 258us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587162.581172:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587162.581254:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1875469127585536:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788587162.581501:0:17191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788587162.581568:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83756a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1875469127585664:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587162.581603:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587162.581916:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788587162.582076:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127585664 00000100:00100000:2.0:1788587162.582082:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127585664 00000100:00100000:2.0:1788587162.582114:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587162.582132:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1875469127585664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587162.582373:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17191:x1875469127585664:12345-0@lo:1000:mdt00_000.0 Request processed in 242us (768us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788587162.582381:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788587162.582606:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83756a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17191:1875469127585664:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788587162.582646:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582656:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582663:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582669:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2051600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.582673:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582680:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582706:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:3.0:1788587162.582708:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587162.582713:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582720:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2051600/0xfbc93bbea5fdb18b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582749:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582755:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582760:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582764:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc21fe400 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.582766:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582772:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582780:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587162.582782:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587162.582789:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582800:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582815:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.582884:0:17191:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f5a8224dc00/0xfbc93bbea5fdb0ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d0d expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.582896:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83755c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1875469127585792:192.168.203.1@tcp:105: 00000100:00100000:3.0:1788587162.582999:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f5a81b7c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587162.586295:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1788587162.586392:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83755c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17191:1875469127585792:192.168.203.1@tcp:105: 00010000:00010000:3.0:1788587162.586447:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586459:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc21fe400/0xfbc93bbea5fdb0e3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586496:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586512:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586523:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586534:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586540:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586560:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586566:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5ba1aa7600 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.586570:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586577:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586589:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587162.586592:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587162.586595:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586601:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5ba1aa7600/0xfbc93bbea5fdb192 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586610:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586616:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586621:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586626:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050a00 already unused, calling callback (ffffffffc19ef4f0) 00010000:00010000:3.0:1788587162.586629:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586642:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586649:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:3.0:1788587162.586651:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587162.586654:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.586659:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050a00/0xfbc93bbea5fdb184 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587162.586797:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbcb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+19:15646:x1875469110745472:12345-192.168.203.1@tcp:57:lhsmtool_posix.0 Request processed in 18054us (18421us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788587162.586806:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 63 00000020:00080000:3.0:1788587162.586811:0:17191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788587162.588072:0:17226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788587162.588080:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587162.588097:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788587162.588104:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788587162.589120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.589409:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110745856 00000100:00100000:1.0:1788587162.589446:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110745856 00000100:00100000:2.0:1788587162.589521:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110746112 00000100:00100000:2.0:1788587162.589526:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110746112 00000100:00100000:2.0:1788587162.589549:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:2.0:1788587162.589559:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5baf153850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+20:15645:x1875469110745856:12345-192.168.203.1@tcp:49:dd.0 00000100:00100000:2.0:1788587162.589678:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5baf153850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+20:15645:x1875469110745856:12345-192.168.203.1@tcp:49:dd.0 Request processed in 119us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.589686:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 10 00000100:00100000:2.0:1788587162.589727:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 11 00000100:00100000:2.0:1788587162.589735:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+19:15646:x1875469110746112:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788587162.589959:0:17195:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788587162.590006:0:17195:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788587162.590041:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.590056:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.590066:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.590091:0:17195:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.590098:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.590104:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.590127:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587162.590170:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15646:x1875469110746112:12345-192.168.203.1@tcp:35:lhsmtool_posix.0 Request processed in 436us (1057us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788587162.590178:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 11 00000020:00080000:2.0:1788587162.590182:0:17195:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587162.590381:0:18723:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587162.590388:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.590395:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050400 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:0.0:1788587162.590400:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.590451:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.590463:0:18723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f5b8399a400) 00010000:00010000:0.0:1788587162.590466:0:18723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587162.590471:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.590477:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050400/0xfbc93bbea5fdb199 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.590489:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587162.590491:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587162.590492:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587162.592646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.593617:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110746240 00000100:00100000:2.0:1788587162.593629:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110746240 00000100:00100000:2.0:1788587162.593692:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:2.0:1788587162.593703:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+21:15645:x1875469110746240:12345-192.168.203.1@tcp:101:dd.0 00010000:00010000:2.0:1788587162.593722:0:20330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587162.593741:0:20330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fdb1a0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x67b316c86c810d45 expref: -99 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.593776:0:20330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb1a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.593790:0:20330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.593802:0:20330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.593922:0:20330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050c00/0xfbc93bbea5fdb1a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d45 expref: 23 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.593942:0:20330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f5bc2050000/0xfbc93bbea5fdb1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0x67b316c86c810d45 expref: 22 pid: 20330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.593952:0:20330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f5b8399a900) 00010000:00010000:2.0:1788587162.593955:0:20330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587162.593958:0:20330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f5bc2050000, rc 0) 00000100:00100000:2.0:1788587162.594030:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cea8b0dc-76f5-470d-a41c-45365485d47c+22:15645:x1875469110746240:12345-192.168.203.1@tcp:101:dd.0 Request processed in 328us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587162.594037:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 64 00000100:00100000:3.0:1788587162.776221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1788587162.776956:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110746368 00000100:00100000:1.0:1788587162.776968:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110746368 00000100:00100000:1.0:1788587162.777060:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 0 00000100:00100000:1.0:1788587162.777071:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2409:x1875469110746368:12345-192.168.203.1@tcp:4:dd.0 00002000:00010000:1.0:1788587162.777129:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9bac9a, atime: 0x6a9bac99, ctime: 0x6a9bac9a, blocks: 0x0 00010000:00010000:1.0:1788587162.777153:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.777171:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788587162.777175:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587162.777182:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.777197:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587162.778746:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1788587162.778868:0:18704:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587162.778878:0:18704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788587162.786625:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469110746496 00000100:00100000:3.0:1788587162.786638:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469110746496 00000100:00100000:2.0:1788587162.790273:0:20332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 1 00000100:00100000:2.0:1788587162.790292:0:20332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+8:2408:x1875469110746496:12345-192.168.203.1@tcp:4:dd.0 00010000:00010000:2.0:1788587162.790340:0:20332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790359:0:20332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.790363:0:20332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587162.790369:0:20332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.790383:0:20332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587162.896018:0:19513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788587162.896039:0:19513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788587162.896455:0:18702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788587162.896461:0:18702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788587162.896479:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.896492:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.896501:0:18702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.896509:0:18702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5a8224d200 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:1.0:1788587162.896514:0:18702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.896523:0:18702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.896566:0:18702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.896574:0:18702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ffa8e89/0xfbc93bbea5fdb1ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587162.897574:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cea8b0dc-76f5-470d-a41c-45365485d47c+7:2409:x1875469110746368:12345-192.168.203.1@tcp:4:dd.0 Request processed in 120496us (121353us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788587162.897588:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 0 00000001:00080000:0.0:1788587162.934202:0:19513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788587162.934395:0:20332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788587162.934401:0:20332:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788587162.934458:0:20332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.934471:0:20332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.934480:0:20332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.934488:0:20332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f5bc2050c00 already unused, calling callback (ffffffffc0dc14f0) 00010000:00010000:2.0:1788587162.934493:0:20332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.934501:0:20332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.934520:0:20332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587162.934528:0:20332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4270fa1/0xfbc93bbea5fdb1b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587162.935328:0:20332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cea8b0dc-76f5-470d-a41c-45365485d47c+5:2408:x1875469110746496:12345-192.168.203.1@tcp:4:dd.0 Request processed in 144374us (155920us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788587162.935350:0:20332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 1 00010000:00010000:2.0:1788587163.029523:0:17179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587163.991143:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127585920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587163.991697:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587163.991757:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127585920 00000100:00100000:2.0:1788587163.991764:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127585920 00000100:00100000:2.0:1788587163.991810:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587163.991819:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127585920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587163.991847:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788587163.991889:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127585920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587163.991896:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788587163.993352:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587163.993779:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127585920:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788587164.053007:0:17180:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587164.415049:0:20369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1788587164.502295:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587164.502327:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127586048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587164.502395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587164.502632:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586048 00000100:00100000:2.0:1788587164.502640:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586048 00000100:00100000:2.0:1788587164.502681:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587164.502689:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127586048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587164.503026:0:17197:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788587164.503078:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127586048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 389us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587164.503085:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587164.503825:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127586048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587164.512642:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127586176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587164.512729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587164.512822:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586176 00000100:00100000:1.0:1788587164.512839:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586176 00000100:00100000:1.0:1788587164.512886:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587164.512895:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127586176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587164.512925:0:17196:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788587164.520520:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127586176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7615us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587164.520610:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788587164.520947:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127586176:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788587165.076683:0:18723:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587165.524568:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587165.524590:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127586304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587165.524659:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.524703:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586304 00000100:00100000:2.0:1788587165.524710:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586304 00000100:00100000:2.0:1788587165.524764:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587165.524773:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127586304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587165.524797:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788587165.524841:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127586304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.524847:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788587165.524865:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587165.524891:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788587165.524896:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f5bbc79ed80, transno 8589934596 00000004:00080000:2.0:1788587165.524906:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788587165.524933:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127586304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587165.525522:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587165.525534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5a83754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127586432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587165.525569:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.526377:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586432 00000100:00100000:2.0:1788587165.526386:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586432 00000100:00100000:2.0:1788587165.526471:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587165.526484:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127586432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587165.526513:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788587165.526580:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875469127586432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.526604:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788587165.526633:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587165.526782:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127586688:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.526821:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.526851:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127587200:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.526876:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.526900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127587712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.526929:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.526961:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788587165.526969:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127586816:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.526996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.527022:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127587328:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527048:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.527071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127587840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.527139:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587712 00000100:00100000:2.0:1788587165.527143:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587712 00000100:00100000:2.0:1788587165.527186:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586816 00000100:00100000:2.0:1788587165.527190:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586816 00000100:00100000:2.0:1788587165.527212:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587328 00000100:00100000:2.0:1788587165.527215:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587328 00000100:00100000:2.0:1788587165.527233:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587840 00000100:00100000:2.0:1788587165.527236:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587840 00000100:00100000:2.0:1788587165.527260:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788587165.527270:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127587712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527330:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875469127587712:12345-0@lo:400:kworker.0 Request processed in 62us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.527345:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788587165.527374:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587165.527383:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127586816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527441:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875469127586816:12345-0@lo:400:kworker.0 Request processed in 61us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.527448:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587165.527470:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788587165.527480:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127587328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527517:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875469127587328:12345-0@lo:400:kworker.0 Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.527525:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788587165.527545:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587165.527553:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127587840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527589:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875469127587840:12345-0@lo:400:kworker.0 Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.527597:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788587165.527620:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587165.527624:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587165.527659:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875469127586816:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527678:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875469127587328:0@lo:400:kworker.0 00010000:00080000:2.0:1788587165.527696:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bb4e36d80 x1875469127587840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587165.527707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bb4e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875469127587840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.527726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875469127587712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.529682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127586560:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.529754:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.529795:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127587072:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.529823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.529844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127587584:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.529868:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.529913:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5a83754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875469127586432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587165.529934:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788587165.529940:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127586944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.529965:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.529991:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127587456:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530010:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.530044:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587200 00000100:00100000:2.0:1788587165.530049:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587200 00000100:00100000:2.0:1788587165.530098:0:18698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587072 00000100:00100000:2.0:1788587165.530101:0:18698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587072 00000100:00100000:2.0:1788587165.530121:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587165.530130:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127587200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530180:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5ba7aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875469127587200:12345-0@lo:400:kworker.0 Request processed in 51us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.530187:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587165.530201:0:18698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587165.530208:0:18698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127587072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530237:0:18698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127587072:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.530258:0:18698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788587165.530277:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587165.530280:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587165.530297:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127587072:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530326:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587584 00000100:00100000:2.0:1788587165.530329:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587584 00000100:00100000:2.0:1788587165.530371:0:20330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587456 00000100:00100000:2.0:1788587165.530374:0:20330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587456 00000100:00100000:2.0:1788587165.530388:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587165.530394:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127587584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530451:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875469127587584:12345-0@lo:400:kworker.0 Request processed in 58us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.530458:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587165.530470:0:20330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587165.530476:0:20330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127587456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530506:0:20330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875469127587456:12345-0@lo:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.530512:0:20330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788587165.530526:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587165.530530:0:17187:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587165.530549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875469127587456:0@lo:400:kworker.0 00010000:00080000:2.0:1788587165.530563:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f5bbc79f100 x1875469127587584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587165.530573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875469127587584:0@lo:400:kworker.0 00000100:00100000:2.0:1788587165.530597:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875469127587200:0@lo:400:kworker.0 00000100:00100000:0.0:1788587165.531057:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586688 00000100:00100000:0.0:1788587165.531063:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586688 00000100:00100000:0.0:1788587165.531091:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586944 00000100:00100000:0.0:1788587165.531094:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586944 00000100:00100000:0.0:1788587165.531107:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788587165.531114:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127586688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587165.531171:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bb4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875469127586688:12345-0@lo:400:kworker.0 Request processed in 58us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587165.531178:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788587165.531192:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587165.531198:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a84522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127586944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587165.531238:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a84522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875469127586944:12345-0@lo:400:kworker.0 Request processed in 40us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587165.531244:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:0.0:1788587165.532541:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587165.532651:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875469127586944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587165.532687:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875469127586688:0@lo:400:kworker.0 00000100:00100000:3.0:1788587165.533828:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127586560 00000100:00100000:3.0:1788587165.533839:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127586560 00000100:00100000:2.0:1788587165.534859:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f5bbc79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127587968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587165.534925:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587165.534975:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469127587968 00000100:00100000:2.0:1788587165.534980:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469127587968 00000100:00100000:2.0:1788587165.535019:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587165.535027:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5bbc79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127587968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587165.535049:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788587165.535089:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5bbc79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875469127587968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587165.535095:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587165.535140:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875469127587968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587165.536255:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788587165.536272:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f5a81b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:3647:x1875469127586560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587165.536361:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f5a81b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf956867-663d-4ecf-b775-8366b2c643ae+24:3647:x1875469127586560:12345-0@lo:400:kworker.0 Request processed in 96us (6606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587165.536369:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788587165.537759:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f5bbc79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bf956867-663d-4ecf-b775-8366b2c643ae:3647:1875469127586560:0@lo:400:kworker.0 Debug log: 41258 lines, 41258 kept, 0 dropped, 0 bad.